Aug 09 22:45:37 user nova-compute[72409]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 09 22:45:40 user nova-compute[72409]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72409) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 22:45:40 user nova-compute[72409]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72409) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 22:45:40 user nova-compute[72409]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72409) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 22:45:40 user nova-compute[72409]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 09 22:45:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:45:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:45:40 user nova-compute[72409]: INFO nova.virt.driver [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 09 22:45:41 user nova-compute[72409]: INFO nova.compute.provider_config [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] Acquiring lock "singleton_lock" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] Acquired lock "singleton_lock" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] Releasing lock "singleton_lock" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] Full set of CONF: {{(pid=72409) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ******************************************************************************** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] Configuration options gathered from: {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ================================================================================ {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] allow_resize_to_same_host      = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] arq_binding_timeout            = 300 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] backdoor_port                  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] backdoor_socket                = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] block_device_allocate_retries  = 300 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] block_device_allocate_retries_interval = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cert                           = self.pem {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute_monitors               = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] config_dir                     = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] config_drive_format            = iso9660 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] config_source                  = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] console_host                   = user {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] control_exchange               = nova {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cpu_allocation_ratio           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] daemon                         = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] debug                          = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] default_access_ip_network_name = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] default_availability_zone      = nova {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] default_ephemeral_format       = ext4 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] default_schedule_zone          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] disk_allocation_ratio          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] enable_new_services            = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] enabled_ssl_apis               = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] flat_injected                  = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] force_config_drive             = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] force_raw_images               = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] graceful_shutdown_timeout      = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] heal_instance_info_cache_interval = 60 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] host                           = user {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] instance_build_timeout         = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] instance_delete_interval       = 300 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] instance_name_template         = instance-%08x {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] instance_usage_audit           = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] instance_usage_audit_period    = month {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] internal_service_availability_zone = internal {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] key                            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] live_migration_retry_count     = 30 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] log_config_append              = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] log_dir                        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] log_file                       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] log_options                    = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] log_rotate_interval            = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] log_rotate_interval_type       = days {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] log_rotation_type              = none {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] long_rpc_timeout               = 1800 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] max_concurrent_builds          = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] max_concurrent_live_migrations = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] max_concurrent_snapshots       = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] max_local_block_devices        = 3 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] max_logfile_count              = 30 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] max_logfile_size_mb            = 200 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] maximum_instance_delete_attempts = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] metadata_listen                = 0.0.0.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] metadata_listen_port           = 8775 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] metadata_workers               = 3 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] migrate_max_retries            = -1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] mkisofs_cmd                    = genisoimage {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] my_ip                          = 10.0.0.210 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] network_allocate_retries       = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] osapi_compute_listen_port      = 8774 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] osapi_compute_unique_server_name_scope =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] osapi_compute_workers          = 3 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] password_length                = 12 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] periodic_enable                = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] periodic_fuzzy_delay           = 60 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] pointer_model                  = ps2mouse {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] preallocate_images             = none {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] publish_errors                 = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] pybasedir                      = /opt/stack/nova {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ram_allocation_ratio           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] rate_limit_burst               = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] rate_limit_except_level        = CRITICAL {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] rate_limit_interval            = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] reboot_timeout                 = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] reclaim_instance_interval      = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] record                         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] reimage_timeout_per_gb         = 60 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] report_interval                = 120 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] rescue_timeout                 = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] reserved_host_cpus             = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] reserved_host_disk_mb          = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] reserved_host_memory_mb        = 512 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] reserved_huge_pages            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] resize_confirm_window          = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] resize_fs_using_block_device   = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] resume_guests_state_on_host_boot = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] rpc_response_timeout           = 60 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] run_external_periodic_tasks    = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] running_deleted_instance_action = reap {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] running_deleted_instance_timeout = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] scheduler_instance_sync_interval = 120 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] service_down_time              = 720 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] servicegroup_driver            = db {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] shelved_offload_time           = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] shelved_poll_interval          = 3600 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] shutdown_timeout               = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] source_is_ipv6                 = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ssl_only                       = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] state_path                     = /opt/stack/data/nova {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] sync_power_state_interval      = 600 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] sync_power_state_pool_size     = 1000 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] syslog_log_facility            = LOG_USER {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] tempdir                        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] timeout_nbd                    = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] transport_url                  = **** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] update_resources_interval      = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] use_cow_images                 = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] use_eventlog                   = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] use_journal                    = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] use_json                       = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] use_rootwrap_daemon            = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] use_stderr                     = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] use_syslog                     = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vcpu_pin_set                   = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plugging_is_fatal          = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plugging_timeout           = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] virt_mkfs                      = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] volume_usage_poll_interval     = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] watch_log_file                 = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] web                            = /usr/share/spice-html5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_concurrency.disable_process_locking = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.auth_strategy              = keystone {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.compute_link_prefix        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.dhcp_domain                = novalocal {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.enable_instance_password   = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.glance_link_prefix         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.instance_list_per_project_cells = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.list_records_by_skipping_down_cells = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.local_metadata_per_cell    = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.max_limit                  = 1000 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.metadata_cache_expiration  = 15 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.neutron_default_tenant_id  = default {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.use_forwarded_for          = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.use_neutron_default_nets   = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.vendordata_dynamic_targets = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.vendordata_jsonfile_path   = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.backend_argument         = **** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.config_prefix            = cache.oslo {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.dead_timeout             = 60.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.debug_cache_backend      = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.enable_retry_client      = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.enable_socket_keepalive  = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.enabled                  = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.expiration_time          = 600 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.hashclient_retry_attempts = 2 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.memcache_dead_retry      = 300 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.memcache_password        =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.memcache_sasl_enabled    = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.memcache_username        =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.proxies                  = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.retry_attempts           = 2 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.retry_delay              = 0.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.socket_keepalive_count   = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.socket_keepalive_idle    = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.socket_keepalive_interval = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.tls_allowed_ciphers      = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.tls_cafile               = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.tls_certfile             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.tls_enabled              = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cache.tls_keyfile              = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.auth_section            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.auth_type               = password {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.cafile                  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.certfile                = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.collect_timing          = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.cross_az_attach         = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.debug                   = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.endpoint_template       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.http_retries            = 3 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.insecure                = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.keyfile                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.os_region_name          = RegionOne {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.split_loggers           = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cinder.timeout                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute.cpu_dedicated_set      = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute.cpu_shared_set         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute.image_type_exclude_list = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute.resource_provider_association_refresh = 300 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute.shutdown_retry_interval = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] conductor.workers              = 3 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] console.allowed_origins        = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] console.ssl_ciphers            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] console.ssl_minimum_version    = default {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] consoleauth.token_ttl          = 600 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.cafile                  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.certfile                = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.collect_timing          = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.connect_retries         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.connect_retry_delay     = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.endpoint_override       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.insecure                = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.keyfile                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.max_version             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.min_version             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.region_name             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.service_name            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.service_type            = accelerator {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.split_loggers           = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.status_code_retries     = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.status_code_retry_delay = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.timeout                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] cyborg.version                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.backend               = sqlalchemy {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.connection            = **** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.connection_debug      = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.connection_parameters =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.connection_recycle_time = 3600 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.connection_trace      = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.db_inc_retry_interval = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.db_max_retries        = 20 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.db_max_retry_interval = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.db_retry_interval     = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.max_overflow          = 50 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.max_pool_size         = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.max_retries           = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.mysql_enable_ndb      = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.mysql_wsrep_sync_wait = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.pool_timeout          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.retry_interval        = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.slave_connection      = **** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] database.sqlite_synchronous    = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.backend           = sqlalchemy {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.connection        = **** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.connection_debug  = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.connection_parameters =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.connection_recycle_time = 3600 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.connection_trace  = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.db_inc_retry_interval = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.db_max_retries    = 20 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.db_max_retry_interval = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.db_retry_interval = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.max_overflow      = 50 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.max_pool_size     = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.max_retries       = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.mysql_enable_ndb  = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.pool_timeout      = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.retry_interval    = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.slave_connection  = **** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] api_database.sqlite_synchronous = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] devices.enabled_mdev_types     = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ephemeral_storage_encryption.enabled = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.api_servers             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.cafile                  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.certfile                = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.collect_timing          = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.connect_retries         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.connect_retry_delay     = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.debug                   = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.default_trusted_certificate_ids = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.enable_certificate_validation = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.enable_rbd_download     = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.endpoint_override       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.insecure                = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.keyfile                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.max_version             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.min_version             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.num_retries             = 3 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.rbd_ceph_conf           =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.rbd_connect_timeout     = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.rbd_pool                =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.rbd_user                =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.region_name             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.service_name            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.service_type            = image {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.split_loggers           = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.status_code_retries     = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.status_code_retry_delay = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.timeout                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.verify_glance_signatures = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] glance.version                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] guestfs.debug                  = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.config_drive_cdrom      = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.config_drive_inject_password = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.enable_remotefx         = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.instances_path_share    =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.limit_cpu_features      = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.use_multipath_io        = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.vswitch_name            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] mks.enabled                    = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] image_cache.manager_interval   = 2400 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] image_cache.precache_concurrency = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] image_cache.remove_unused_base_images = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] image_cache.subdirectory_name  = _base {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.api_max_retries         = 60 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.api_retry_interval      = 2 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.auth_section            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.auth_type               = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.cafile                  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.certfile                = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.collect_timing          = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.connect_retries         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.connect_retry_delay     = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.endpoint_override       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.insecure                = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.keyfile                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.max_version             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.min_version             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.partition_key           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.peer_list               = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.region_name             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.serial_console_state_timeout = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.service_name            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.service_type            = baremetal {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.split_loggers           = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.status_code_retries     = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.status_code_retry_delay = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.timeout                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ironic.version                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] key_manager.fixed_key          = **** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.barbican_api_version  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.barbican_endpoint     = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.barbican_endpoint_type = public {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.barbican_region_name  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.cafile                = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.certfile              = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.collect_timing        = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.insecure              = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.keyfile               = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.number_of_retries     = 60 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.retry_delay           = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.send_service_user_token = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.split_loggers         = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.timeout               = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.verify_ssl            = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican.verify_ssl_path       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican_service_user.auth_section = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican_service_user.auth_type = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican_service_user.cafile   = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican_service_user.certfile = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican_service_user.collect_timing = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican_service_user.insecure = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican_service_user.keyfile  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican_service_user.split_loggers = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] barbican_service_user.timeout  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.approle_role_id          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.approle_secret_id        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.cafile                   = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.certfile                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.collect_timing           = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.insecure                 = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.keyfile                  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.kv_mountpoint            = secret {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.kv_version               = 2 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.namespace                = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.root_token_id            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.split_loggers            = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.ssl_ca_crt_file          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.timeout                  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.use_ssl                  = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.cafile                = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.certfile              = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.collect_timing        = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.connect_retries       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.connect_retry_delay   = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.endpoint_override     = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.insecure              = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.keyfile               = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.max_version           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.min_version           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.region_name           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.service_name          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.service_type          = identity {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.split_loggers         = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.status_code_retries   = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.status_code_retry_delay = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.timeout               = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] keystone.version               = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.connection_uri         =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.cpu_mode               = custom {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: WARNING oslo_config.cfg [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.cpu_power_governor_high = performance {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.cpu_power_management   = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.device_detach_attempts = 8 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.device_detach_timeout  = 20 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.disk_cachemodes        = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.disk_prefix            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.enabled_perf_events    = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.file_backed_memory     = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.gid_maps               = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.hw_disk_discard        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.hw_machine_type        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.images_rbd_pool        = rbd {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.images_type            = default {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.images_volume_group    = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.inject_key             = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.inject_partition       = -2 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.inject_password        = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.iscsi_iface            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.iser_use_multipath     = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_downtime = 500 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_inbound_addr = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_scheme  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_timeout_action = abort {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_tunnelled = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: WARNING oslo_config.cfg [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 09 22:45:41 user nova-compute[72409]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 09 22:45:41 user nova-compute[72409]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 09 22:45:41 user nova-compute[72409]: and ``live_migration_inbound_addr`` respectively.
Aug 09 22:45:41 user nova-compute[72409]: ).  Its value may be silently ignored in the future.
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.live_migration_with_native_tls = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.max_queues             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.nfs_mount_options      = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.num_pcie_ports         = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.pmem_namespaces        = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.quobyte_client_cfg     = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.rbd_secret_uuid        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.rbd_user               = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.rescue_image_id        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.rescue_kernel_id       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.rx_queue_size          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.smbfs_mount_options    =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.snapshot_compression   = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.snapshot_image_format  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.sparse_logical_volumes = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.swtpm_enabled          = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.swtpm_group            = tss {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.swtpm_user             = tss {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.sysinfo_serial         = unique {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.tb_cache_size          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.tx_queue_size          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.uid_maps               = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.use_virtio_for_bridges = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.virt_type              = kvm {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.volume_clear           = zero {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.volume_clear_size      = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.volume_use_multipath   = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.vzstorage_cache_path   = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.auth_section           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.auth_type              = password {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.cafile                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.certfile               = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.collect_timing         = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.connect_retries        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.connect_retry_delay    = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.default_floating_pool  = public {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.endpoint_override      = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.extension_sync_interval = 600 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.http_retries           = 3 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.insecure               = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.keyfile                = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.max_version            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.min_version            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.ovs_bridge             = br-int {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.physnets               = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.region_name            = RegionOne {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.service_metadata_proxy = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.service_name           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.service_type           = network {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.split_loggers          = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.status_code_retries    = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.status_code_retry_delay = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.timeout                = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] neutron.version                = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] notifications.bdms_in_notifications = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] notifications.default_level    = INFO {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] notifications.notification_format = unversioned {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] notifications.notify_on_state_change = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] pci.alias                      = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] pci.device_spec                = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] pci.report_in_placement        = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.auth_section         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.auth_type            = password {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.cafile               = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.certfile             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.collect_timing       = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.connect_retries      = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.connect_retry_delay  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.default_domain_id    = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.default_domain_name  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.domain_id            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.domain_name          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.endpoint_override    = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.insecure             = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.keyfile              = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.max_version          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.min_version          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.password             = **** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.project_domain_id    = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.project_domain_name  = Default {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.project_id           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.project_name         = service {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.region_name          = RegionOne {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.service_name         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.service_type         = placement {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.split_loggers        = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.status_code_retries  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.status_code_retry_delay = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.system_scope         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.timeout              = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.trust_id             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.user_domain_id       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.user_domain_name     = Default {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.user_id              = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.username             = placement {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] placement.version              = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.cores                    = 20 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.count_usage_from_placement = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.injected_file_content_bytes = 10240 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.injected_file_path_length = 255 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.injected_files           = 5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.instances                = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.key_pairs                = 100 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.metadata_items           = 128 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.ram                      = 51200 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.recheck_quota            = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.server_group_members     = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] quota.server_groups            = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] rdp.enabled                    = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] scheduler.image_metadata_prefilter = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] scheduler.max_attempts         = 3 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] scheduler.max_placement_results = 1000 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] scheduler.workers              = 3 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.host_subset_size = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.isolated_hosts = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.isolated_images = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.pci_in_placement = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.track_instance_changes = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] metrics.required               = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] metrics.weight_multiplier      = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] metrics.weight_setting         = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] serial_console.enabled         = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] serial_console.port_range      = 10000:20000 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] serial_console.serialproxy_port = 6083 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] service_user.auth_section      = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] service_user.auth_type         = password {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] service_user.cafile            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] service_user.certfile          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] service_user.collect_timing    = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] service_user.insecure          = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] service_user.keyfile           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] service_user.send_service_user_token = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] service_user.split_loggers     = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] service_user.timeout           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] spice.agent_enabled            = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] spice.enabled                  = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] spice.html5proxy_port          = 6082 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] spice.image_compression        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] spice.jpeg_compression         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] spice.playback_compression     = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] spice.server_listen            = 127.0.0.1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] spice.streaming_mode           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] spice.zlib_compression         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] upgrade_levels.baseapi         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] upgrade_levels.cert            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] upgrade_levels.compute         = auto {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] upgrade_levels.conductor       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] upgrade_levels.scheduler       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vendordata_dynamic_auth.cafile = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vendordata_dynamic_auth.certfile = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vendordata_dynamic_auth.insecure = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vendordata_dynamic_auth.timeout = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.api_retry_count         = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.ca_file                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.cache_prefix            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.cluster_name            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.connection_pool_size    = 10 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.console_delay_seconds   = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.datastore_regex         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.host_ip                 = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.host_password           = **** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.host_port               = 443 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.host_username           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.insecure                = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.integration_bridge      = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.maximum_objects         = 100 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.pbm_default_policy      = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.pbm_enabled             = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.pbm_wsdl_location       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.serial_port_proxy_uri   = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.serial_port_service_uri = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.task_poll_interval      = 0.5 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.use_linked_clone        = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.vnc_keymap              = en-us {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.vnc_port                = 5900 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vmware.vnc_port_total          = 10000 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vnc.auth_schemes               = ['none'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vnc.enabled                    = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vnc.novncproxy_port            = 6080 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vnc.vencrypt_ca_certs          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vnc.vencrypt_client_cert       = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vnc.vencrypt_client_key        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.disable_rootwrap   = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.enable_numa_live_migration = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.libvirt_disable_apic = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] wsgi.client_socket_timeout     = 900 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] wsgi.default_pool_size         = 1000 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] wsgi.keep_alive                = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] wsgi.max_header_line           = 16384 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] wsgi.ssl_ca_file               = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] wsgi.ssl_cert_file             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] wsgi.ssl_key_file              = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] wsgi.tcp_keepidle              = 600 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] zvm.ca_file                    = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] zvm.cloud_connector_url        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] zvm.reachable_timeout          = 300 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_policy.enforce_new_defaults = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_policy.enforce_scope      = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_policy.policy_default_rule = default {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler.connection_string     = messaging:// {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler.enabled               = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler.es_doc_type           = notification {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler.es_scroll_size        = 10000 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler.es_scroll_time        = 2m {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler.filter_error_trace    = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler.hmac_keys             = **** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler.sentinel_service_name = mymaster {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler.socket_timeout        = 0.1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler.trace_requests        = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler.trace_sqlalchemy      = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler_jaeger.process_tags   = {} {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler_jaeger.service_name_prefix = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] profiler_otlp.service_name_prefix = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] remote_debug.host              = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] remote_debug.port              = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_notifications.retry = -1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.auth_section        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.auth_type           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.cafile              = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.certfile            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.collect_timing      = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.connect_retries     = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.connect_retry_delay = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.endpoint_id         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.endpoint_override   = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.insecure            = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.keyfile             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.max_version         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.min_version         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.region_name         = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.service_name        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.service_type        = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.split_loggers       = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.status_code_retries = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.status_code_retry_delay = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.timeout             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.valid_interfaces    = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_limit.version             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_reports.file_event_handler = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] oslo_reports.log_dir           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plug_ovs_privileged.group  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] vif_plug_ovs_privileged.user   = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_ovs.isolate_vif         = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] os_brick.lock_path             = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] privsep_osbrick.capabilities   = [21] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] privsep_osbrick.group          = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] privsep_osbrick.helper_command = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] privsep_osbrick.user           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] nova_sys_admin.group           = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] nova_sys_admin.helper_command  = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] nova_sys_admin.user            = None {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG oslo_service.service [None req-f0161b88-1ddc-4ef2-b7ad-75226bb9fed8 None None] ******************************************************************************** {{(pid=72409) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 09 22:45:41 user nova-compute[72409]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 09 22:45:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Starting native event thread {{(pid=72409) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Starting green dispatch thread {{(pid=72409) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Starting connection event dispatch thread {{(pid=72409) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Connecting to libvirt: qemu:///system {{(pid=72409) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4e9e0eca30> {{(pid=72409) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 09 22:45:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4e9e0eca30> {{(pid=72409) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 09 22:45:41 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Connection event '1' reason 'None'
Aug 09 22:45:41 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 22:45:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.mount [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Initialising _HostMountState generation 0 {{(pid=72409) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 09 22:45:49 user nova-compute[72409]: INFO nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Libvirt host capabilities <capabilities>
Aug 09 22:45:49 user nova-compute[72409]:   <host>
Aug 09 22:45:49 user nova-compute[72409]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 09 22:45:49 user nova-compute[72409]:     <cpu>
Aug 09 22:45:49 user nova-compute[72409]:       <arch>x86_64</arch>
Aug 09 22:45:49 user nova-compute[72409]:       <model>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <vendor>Intel</vendor>
Aug 09 22:45:49 user nova-compute[72409]:       <microcode version='1070'/>
Aug 09 22:45:49 user nova-compute[72409]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 09 22:45:49 user nova-compute[72409]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='ss'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='vmx'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='pcid'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='osxsave'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='hypervisor'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='arat'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='tsc_adjust'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='md-clear'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='arch-capabilities'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='invtsc'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='rsba'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature name='skip-l1dfl-vmentry'/>
Aug 09 22:45:49 user nova-compute[72409]:       <pages unit='KiB' size='4'/>
Aug 09 22:45:49 user nova-compute[72409]:       <pages unit='KiB' size='2048'/>
Aug 09 22:45:49 user nova-compute[72409]:     </cpu>
Aug 09 22:45:49 user nova-compute[72409]:     <power_management>
Aug 09 22:45:49 user nova-compute[72409]:       <suspend_mem/>
Aug 09 22:45:49 user nova-compute[72409]:       <suspend_disk/>
Aug 09 22:45:49 user nova-compute[72409]:       <suspend_hybrid/>
Aug 09 22:45:49 user nova-compute[72409]:     </power_management>
Aug 09 22:45:49 user nova-compute[72409]:     <iommu support='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     <migration_features>
Aug 09 22:45:49 user nova-compute[72409]:       <live/>
Aug 09 22:45:49 user nova-compute[72409]:       <uri_transports>
Aug 09 22:45:49 user nova-compute[72409]:         <uri_transport>tcp</uri_transport>
Aug 09 22:45:49 user nova-compute[72409]:         <uri_transport>rdma</uri_transport>
Aug 09 22:45:49 user nova-compute[72409]:       </uri_transports>
Aug 09 22:45:49 user nova-compute[72409]:     </migration_features>
Aug 09 22:45:49 user nova-compute[72409]:     <topology>
Aug 09 22:45:49 user nova-compute[72409]:       <cells num='2'>
Aug 09 22:45:49 user nova-compute[72409]:         <cell id='0'>
Aug 09 22:45:49 user nova-compute[72409]:           <memory unit='KiB'>8140616</memory>
Aug 09 22:45:49 user nova-compute[72409]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 09 22:45:49 user nova-compute[72409]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 22:45:49 user nova-compute[72409]:           <distances>
Aug 09 22:45:49 user nova-compute[72409]:             <sibling id='0' value='10'/>
Aug 09 22:45:49 user nova-compute[72409]:             <sibling id='1' value='20'/>
Aug 09 22:45:49 user nova-compute[72409]:           </distances>
Aug 09 22:45:49 user nova-compute[72409]:           <cpus num='6'>
Aug 09 22:45:49 user nova-compute[72409]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 09 22:45:49 user nova-compute[72409]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 09 22:45:49 user nova-compute[72409]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 09 22:45:49 user nova-compute[72409]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 09 22:45:49 user nova-compute[72409]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 09 22:45:49 user nova-compute[72409]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 09 22:45:49 user nova-compute[72409]:           </cpus>
Aug 09 22:45:49 user nova-compute[72409]:         </cell>
Aug 09 22:45:49 user nova-compute[72409]:         <cell id='1'>
Aug 09 22:45:49 user nova-compute[72409]:           <memory unit='KiB'>8255068</memory>
Aug 09 22:45:49 user nova-compute[72409]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 09 22:45:49 user nova-compute[72409]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 22:45:49 user nova-compute[72409]:           <distances>
Aug 09 22:45:49 user nova-compute[72409]:             <sibling id='0' value='20'/>
Aug 09 22:45:49 user nova-compute[72409]:             <sibling id='1' value='10'/>
Aug 09 22:45:49 user nova-compute[72409]:           </distances>
Aug 09 22:45:49 user nova-compute[72409]:           <cpus num='6'>
Aug 09 22:45:49 user nova-compute[72409]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 09 22:45:49 user nova-compute[72409]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 09 22:45:49 user nova-compute[72409]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 09 22:45:49 user nova-compute[72409]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 09 22:45:49 user nova-compute[72409]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 09 22:45:49 user nova-compute[72409]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 09 22:45:49 user nova-compute[72409]:           </cpus>
Aug 09 22:45:49 user nova-compute[72409]:         </cell>
Aug 09 22:45:49 user nova-compute[72409]:       </cells>
Aug 09 22:45:49 user nova-compute[72409]:     </topology>
Aug 09 22:45:49 user nova-compute[72409]:     <cache>
Aug 09 22:45:49 user nova-compute[72409]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 09 22:45:49 user nova-compute[72409]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 09 22:45:49 user nova-compute[72409]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 09 22:45:49 user nova-compute[72409]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 09 22:45:49 user nova-compute[72409]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 09 22:45:49 user nova-compute[72409]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 09 22:45:49 user nova-compute[72409]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 09 22:45:49 user nova-compute[72409]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 09 22:45:49 user nova-compute[72409]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 09 22:45:49 user nova-compute[72409]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 09 22:45:49 user nova-compute[72409]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 09 22:45:49 user nova-compute[72409]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 09 22:45:49 user nova-compute[72409]:     </cache>
Aug 09 22:45:49 user nova-compute[72409]:     <secmodel>
Aug 09 22:45:49 user nova-compute[72409]:       <model>apparmor</model>
Aug 09 22:45:49 user nova-compute[72409]:       <doi>0</doi>
Aug 09 22:45:49 user nova-compute[72409]:     </secmodel>
Aug 09 22:45:49 user nova-compute[72409]:     <secmodel>
Aug 09 22:45:49 user nova-compute[72409]:       <model>dac</model>
Aug 09 22:45:49 user nova-compute[72409]:       <doi>0</doi>
Aug 09 22:45:49 user nova-compute[72409]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 09 22:45:49 user nova-compute[72409]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 09 22:45:49 user nova-compute[72409]:     </secmodel>
Aug 09 22:45:49 user nova-compute[72409]:   </host>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='alpha'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>64</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>clipper</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='armv6l'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>spitz</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>nuri</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>kzm</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sx1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>z2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>tosa</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>n810</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>n800</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>terrier</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>midway</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>microbit</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>verdex</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>highbank</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>akita</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>connex</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>collie</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='armv7l'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>spitz</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>nuri</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>kzm</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sx1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>z2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>tosa</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>n810</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>n800</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>terrier</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>midway</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>microbit</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>verdex</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>highbank</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>akita</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>connex</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>collie</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='aarch64'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>64</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>spitz</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>nuri</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>kzm</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sx1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>z2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>tosa</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>n810</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>n800</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>terrier</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>midway</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>microbit</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>verdex</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>raspi3b</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>highbank</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>akita</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>connex</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>collie</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <acpi default='on' toggle='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='cris'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='i686'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>isapc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>microvm</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='kvm'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <pae/>
Aug 09 22:45:49 user nova-compute[72409]:       <nonpae/>
Aug 09 22:45:49 user nova-compute[72409]:       <acpi default='on' toggle='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:       <apic default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='m68k'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>an5206</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>q800</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>next-cube</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='microblaze'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='microblazeel'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='mips'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='16'>malta</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='mipsel'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='16'>malta</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='mips64'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>64</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='16'>malta</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>pica61</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>magnum</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='mips64el'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>64</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='16'>malta</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>pica61</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>magnum</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='16'>boston</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='ppc'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mac99</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>40p</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>taihu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='ppc64'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>64</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>taihu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>40p</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mac99</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='ppc64le'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>64</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>taihu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>40p</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>mac99</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='riscv32'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='8'>spike</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>opentitan</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='8'>virt</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='riscv64'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>64</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='8'>spike</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>shakti_c</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='8'>virt</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='s390x'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>64</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='sh4'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>shix</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>r2d</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='sh4eb'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>64</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>shix</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>r2d</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='sparc'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>SS-5</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>SS-20</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>LX</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>SS-4</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>SS-10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>Voyager</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='sparc64'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>64</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sun4u</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>niagara</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>sun4v</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='x86_64'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>64</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='1'>isapc</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>microvm</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='kvm'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <acpi default='on' toggle='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:       <apic default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='xtensa'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>sim</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>kc705</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>ml605</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>virt</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>lx200</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>lx60</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]:   <guest>
Aug 09 22:45:49 user nova-compute[72409]:     <os_type>hvm</os_type>
Aug 09 22:45:49 user nova-compute[72409]:     <arch name='xtensaeb'>
Aug 09 22:45:49 user nova-compute[72409]:       <wordsize>32</wordsize>
Aug 09 22:45:49 user nova-compute[72409]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='4'>sim</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>kc705</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>ml605</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>virt</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>lx200</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>lx60</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 22:45:49 user nova-compute[72409]:       <domain type='qemu'/>
Aug 09 22:45:49 user nova-compute[72409]:     </arch>
Aug 09 22:45:49 user nova-compute[72409]:     <features>
Aug 09 22:45:49 user nova-compute[72409]:       <cpuselection/>
Aug 09 22:45:49 user nova-compute[72409]:       <deviceboot/>
Aug 09 22:45:49 user nova-compute[72409]:       <disksnapshot default='on' toggle='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     </features>
Aug 09 22:45:49 user nova-compute[72409]:   </guest>
Aug 09 22:45:49 user nova-compute[72409]: </capabilities>
Aug 09 22:45:49 user nova-compute[72409]: 
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 09 22:45:49 user nova-compute[72409]: <domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 22:45:49 user nova-compute[72409]:   <domain>kvm</domain>
Aug 09 22:45:49 user nova-compute[72409]:   <machine>pc-q35-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:   <arch>i686</arch>
Aug 09 22:45:49 user nova-compute[72409]:   <vcpu max='288'/>
Aug 09 22:45:49 user nova-compute[72409]:   <iothreads supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:   <os supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='firmware'/>
Aug 09 22:45:49 user nova-compute[72409]:     <loader supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>rom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pflash</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='readonly'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>yes</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='secure'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </loader>
Aug 09 22:45:49 user nova-compute[72409]:   </os>
Aug 09 22:45:49 user nova-compute[72409]:   <cpu>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-passthrough' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='hostPassthroughMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='maximum' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='maximumMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>on</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-model' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <vendor>Intel</vendor>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ss'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='vmx'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='pcid'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='hypervisor'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arat'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='umip'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='md-clear'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibpb'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibrs'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='erms'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='lm'/>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='custom' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>qemu64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>qemu32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>phenom</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>n270</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>kvm64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>kvm32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>coreduo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>core2duo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>athlon</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Westmere</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Snowridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Penryn</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G5</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G4</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G1</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Nehalem</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Rome</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Milan</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Dhyana</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cooperlake</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Conroe</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>486</model>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:   </cpu>
Aug 09 22:45:49 user nova-compute[72409]:   <memoryBacking supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='sourceType'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>file</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>anonymous</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>memfd</value>
Aug 09 22:45:49 user nova-compute[72409]:     </enum>
Aug 09 22:45:49 user nova-compute[72409]:   </memoryBacking>
Aug 09 22:45:49 user nova-compute[72409]:   <devices>
Aug 09 22:45:49 user nova-compute[72409]:     <disk supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='diskDevice'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>disk</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cdrom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>floppy</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>lun</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='bus'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>fdc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sata</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </disk>
Aug 09 22:45:49 user nova-compute[72409]:     <graphics supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sdl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vnc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>spice</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egl-headless</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </graphics>
Aug 09 22:45:49 user nova-compute[72409]:     <video supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='modelType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cirrus</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vmvga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>qxl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>none</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>bochs</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>ramfb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </video>
Aug 09 22:45:49 user nova-compute[72409]:     <hostdev supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='mode'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>subsystem</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='startupPolicy'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>default</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>mandatory</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>requisite</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>optional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='subsysType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pci</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='capsType'/>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='pciBackend'/>
Aug 09 22:45:49 user nova-compute[72409]:     </hostdev>
Aug 09 22:45:49 user nova-compute[72409]:     <rng supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>random</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egd</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>builtin</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </rng>
Aug 09 22:45:49 user nova-compute[72409]:     <filesystem supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='driverType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>path</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>handle</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtiofs</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </filesystem>
Aug 09 22:45:49 user nova-compute[72409]:     <tpm supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-tis</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-crb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>passthrough</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>emulator</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </tpm>
Aug 09 22:45:49 user nova-compute[72409]:   </devices>
Aug 09 22:45:49 user nova-compute[72409]:   <features>
Aug 09 22:45:49 user nova-compute[72409]:     <gic supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     <vmcoreinfo supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <genid supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backingStoreInput supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backup supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <sev supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:   </features>
Aug 09 22:45:49 user nova-compute[72409]: </domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:  {{(pid=72409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 09 22:45:49 user nova-compute[72409]: <domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 22:45:49 user nova-compute[72409]:   <domain>kvm</domain>
Aug 09 22:45:49 user nova-compute[72409]:   <machine>pc-i440fx-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:   <arch>i686</arch>
Aug 09 22:45:49 user nova-compute[72409]:   <vcpu max='255'/>
Aug 09 22:45:49 user nova-compute[72409]:   <iothreads supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:   <os supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='firmware'/>
Aug 09 22:45:49 user nova-compute[72409]:     <loader supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>rom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pflash</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='readonly'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>yes</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='secure'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </loader>
Aug 09 22:45:49 user nova-compute[72409]:   </os>
Aug 09 22:45:49 user nova-compute[72409]:   <cpu>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-passthrough' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='hostPassthroughMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='maximum' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='maximumMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>on</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-model' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <vendor>Intel</vendor>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ss'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='vmx'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='pcid'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='hypervisor'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arat'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='umip'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='md-clear'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibpb'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibrs'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='erms'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='lm'/>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='custom' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>qemu64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>qemu32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>phenom</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>n270</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>kvm64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>kvm32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>coreduo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>core2duo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>athlon</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Westmere</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Snowridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Penryn</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G5</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G4</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G1</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Nehalem</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Rome</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Milan</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Dhyana</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cooperlake</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Conroe</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>486</model>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:   </cpu>
Aug 09 22:45:49 user nova-compute[72409]:   <memoryBacking supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='sourceType'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>file</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>anonymous</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>memfd</value>
Aug 09 22:45:49 user nova-compute[72409]:     </enum>
Aug 09 22:45:49 user nova-compute[72409]:   </memoryBacking>
Aug 09 22:45:49 user nova-compute[72409]:   <devices>
Aug 09 22:45:49 user nova-compute[72409]:     <disk supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='diskDevice'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>disk</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cdrom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>floppy</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>lun</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='bus'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>ide</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>fdc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sata</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </disk>
Aug 09 22:45:49 user nova-compute[72409]:     <graphics supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sdl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vnc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>spice</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egl-headless</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </graphics>
Aug 09 22:45:49 user nova-compute[72409]:     <video supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='modelType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cirrus</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vmvga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>qxl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>none</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>bochs</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>ramfb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </video>
Aug 09 22:45:49 user nova-compute[72409]:     <hostdev supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='mode'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>subsystem</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='startupPolicy'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>default</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>mandatory</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>requisite</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>optional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='subsysType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pci</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='capsType'/>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='pciBackend'/>
Aug 09 22:45:49 user nova-compute[72409]:     </hostdev>
Aug 09 22:45:49 user nova-compute[72409]:     <rng supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>random</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egd</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>builtin</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </rng>
Aug 09 22:45:49 user nova-compute[72409]:     <filesystem supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='driverType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>path</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>handle</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtiofs</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </filesystem>
Aug 09 22:45:49 user nova-compute[72409]:     <tpm supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-tis</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-crb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>passthrough</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>emulator</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </tpm>
Aug 09 22:45:49 user nova-compute[72409]:   </devices>
Aug 09 22:45:49 user nova-compute[72409]:   <features>
Aug 09 22:45:49 user nova-compute[72409]:     <gic supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     <vmcoreinfo supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <genid supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backingStoreInput supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backup supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <sev supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:   </features>
Aug 09 22:45:49 user nova-compute[72409]: </domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:  {{(pid=72409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 09 22:45:49 user nova-compute[72409]: <domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 22:45:49 user nova-compute[72409]:   <domain>kvm</domain>
Aug 09 22:45:49 user nova-compute[72409]:   <machine>pc-i440fx-jammy</machine>
Aug 09 22:45:49 user nova-compute[72409]:   <arch>i686</arch>
Aug 09 22:45:49 user nova-compute[72409]:   <vcpu max='255'/>
Aug 09 22:45:49 user nova-compute[72409]:   <iothreads supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:   <os supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='firmware'/>
Aug 09 22:45:49 user nova-compute[72409]:     <loader supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>rom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pflash</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='readonly'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>yes</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='secure'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </loader>
Aug 09 22:45:49 user nova-compute[72409]:   </os>
Aug 09 22:45:49 user nova-compute[72409]:   <cpu>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-passthrough' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='hostPassthroughMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='maximum' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='maximumMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>on</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-model' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <vendor>Intel</vendor>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ss'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='vmx'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='pcid'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='hypervisor'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arat'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='umip'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='md-clear'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibpb'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibrs'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='erms'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='lm'/>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='custom' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>qemu64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>qemu32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>phenom</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>n270</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>kvm64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>kvm32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>coreduo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>core2duo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>athlon</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Westmere</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Snowridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Penryn</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G5</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G4</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G1</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Nehalem</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Rome</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Milan</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Dhyana</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cooperlake</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Conroe</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>486</model>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:   </cpu>
Aug 09 22:45:49 user nova-compute[72409]:   <memoryBacking supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='sourceType'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>file</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>anonymous</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>memfd</value>
Aug 09 22:45:49 user nova-compute[72409]:     </enum>
Aug 09 22:45:49 user nova-compute[72409]:   </memoryBacking>
Aug 09 22:45:49 user nova-compute[72409]:   <devices>
Aug 09 22:45:49 user nova-compute[72409]:     <disk supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='diskDevice'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>disk</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cdrom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>floppy</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>lun</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='bus'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>ide</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>fdc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sata</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </disk>
Aug 09 22:45:49 user nova-compute[72409]:     <graphics supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sdl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vnc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>spice</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egl-headless</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </graphics>
Aug 09 22:45:49 user nova-compute[72409]:     <video supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='modelType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cirrus</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vmvga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>qxl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>none</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>bochs</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>ramfb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </video>
Aug 09 22:45:49 user nova-compute[72409]:     <hostdev supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='mode'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>subsystem</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='startupPolicy'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>default</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>mandatory</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>requisite</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>optional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='subsysType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pci</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='capsType'/>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='pciBackend'/>
Aug 09 22:45:49 user nova-compute[72409]:     </hostdev>
Aug 09 22:45:49 user nova-compute[72409]:     <rng supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>random</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egd</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>builtin</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </rng>
Aug 09 22:45:49 user nova-compute[72409]:     <filesystem supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='driverType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>path</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>handle</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtiofs</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </filesystem>
Aug 09 22:45:49 user nova-compute[72409]:     <tpm supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-tis</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-crb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>passthrough</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>emulator</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </tpm>
Aug 09 22:45:49 user nova-compute[72409]:   </devices>
Aug 09 22:45:49 user nova-compute[72409]:   <features>
Aug 09 22:45:49 user nova-compute[72409]:     <gic supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     <vmcoreinfo supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <genid supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backingStoreInput supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backup supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <sev supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:   </features>
Aug 09 22:45:49 user nova-compute[72409]: </domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:  {{(pid=72409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 09 22:45:49 user nova-compute[72409]: <domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 22:45:49 user nova-compute[72409]:   <domain>kvm</domain>
Aug 09 22:45:49 user nova-compute[72409]:   <machine>pc-q35-jammy</machine>
Aug 09 22:45:49 user nova-compute[72409]:   <arch>i686</arch>
Aug 09 22:45:49 user nova-compute[72409]:   <vcpu max='288'/>
Aug 09 22:45:49 user nova-compute[72409]:   <iothreads supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:   <os supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='firmware'/>
Aug 09 22:45:49 user nova-compute[72409]:     <loader supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>rom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pflash</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='readonly'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>yes</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='secure'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </loader>
Aug 09 22:45:49 user nova-compute[72409]:   </os>
Aug 09 22:45:49 user nova-compute[72409]:   <cpu>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-passthrough' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='hostPassthroughMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='maximum' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='maximumMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>on</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-model' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <vendor>Intel</vendor>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ss'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='vmx'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='pcid'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='hypervisor'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arat'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='umip'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='md-clear'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibpb'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibrs'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='erms'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='lm'/>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='custom' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>qemu64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>qemu32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>phenom</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>n270</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>kvm64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>kvm32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>coreduo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>core2duo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>athlon</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Westmere</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Snowridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Penryn</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G5</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G4</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G1</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Nehalem</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Rome</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Milan</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Dhyana</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cooperlake</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Conroe</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>486</model>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:   </cpu>
Aug 09 22:45:49 user nova-compute[72409]:   <memoryBacking supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='sourceType'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>file</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>anonymous</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>memfd</value>
Aug 09 22:45:49 user nova-compute[72409]:     </enum>
Aug 09 22:45:49 user nova-compute[72409]:   </memoryBacking>
Aug 09 22:45:49 user nova-compute[72409]:   <devices>
Aug 09 22:45:49 user nova-compute[72409]:     <disk supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='diskDevice'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>disk</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cdrom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>floppy</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>lun</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='bus'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>fdc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sata</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </disk>
Aug 09 22:45:49 user nova-compute[72409]:     <graphics supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sdl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vnc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>spice</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egl-headless</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </graphics>
Aug 09 22:45:49 user nova-compute[72409]:     <video supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='modelType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cirrus</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vmvga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>qxl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>none</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>bochs</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>ramfb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </video>
Aug 09 22:45:49 user nova-compute[72409]:     <hostdev supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='mode'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>subsystem</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='startupPolicy'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>default</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>mandatory</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>requisite</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>optional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='subsysType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pci</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='capsType'/>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='pciBackend'/>
Aug 09 22:45:49 user nova-compute[72409]:     </hostdev>
Aug 09 22:45:49 user nova-compute[72409]:     <rng supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>random</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egd</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>builtin</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </rng>
Aug 09 22:45:49 user nova-compute[72409]:     <filesystem supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='driverType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>path</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>handle</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtiofs</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </filesystem>
Aug 09 22:45:49 user nova-compute[72409]:     <tpm supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-tis</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-crb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>passthrough</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>emulator</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </tpm>
Aug 09 22:45:49 user nova-compute[72409]:   </devices>
Aug 09 22:45:49 user nova-compute[72409]:   <features>
Aug 09 22:45:49 user nova-compute[72409]:     <gic supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     <vmcoreinfo supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <genid supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backingStoreInput supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backup supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <sev supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:   </features>
Aug 09 22:45:49 user nova-compute[72409]: </domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:  {{(pid=72409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 09 22:45:49 user nova-compute[72409]: <domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 22:45:49 user nova-compute[72409]:   <domain>kvm</domain>
Aug 09 22:45:49 user nova-compute[72409]:   <machine>pc-q35-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:   <arch>x86_64</arch>
Aug 09 22:45:49 user nova-compute[72409]:   <vcpu max='288'/>
Aug 09 22:45:49 user nova-compute[72409]:   <iothreads supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:   <os supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='firmware'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>efi</value>
Aug 09 22:45:49 user nova-compute[72409]:     </enum>
Aug 09 22:45:49 user nova-compute[72409]:     <loader supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>rom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pflash</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='readonly'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>yes</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='secure'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>yes</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </loader>
Aug 09 22:45:49 user nova-compute[72409]:   </os>
Aug 09 22:45:49 user nova-compute[72409]:   <cpu>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-passthrough' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='hostPassthroughMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>on</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='maximum' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='maximumMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>on</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-model' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <vendor>Intel</vendor>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ss'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='vmx'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='pcid'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='hypervisor'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arat'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='umip'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='md-clear'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='invtsc'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibpb'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibrs'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='rsba'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='erms'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='custom' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>qemu64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>qemu32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>phenom</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>n270</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>kvm64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>kvm32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>coreduo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>core2duo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>athlon</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Westmere</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Snowridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Penryn</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G5</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G4</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Opteron_G1</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Nehalem</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Rome</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Milan</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Dhyana</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cooperlake</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Conroe</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>486</model>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:   </cpu>
Aug 09 22:45:49 user nova-compute[72409]:   <memoryBacking supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='sourceType'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>file</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>anonymous</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>memfd</value>
Aug 09 22:45:49 user nova-compute[72409]:     </enum>
Aug 09 22:45:49 user nova-compute[72409]:   </memoryBacking>
Aug 09 22:45:49 user nova-compute[72409]:   <devices>
Aug 09 22:45:49 user nova-compute[72409]:     <disk supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='diskDevice'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>disk</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cdrom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>floppy</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>lun</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='bus'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>fdc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sata</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </disk>
Aug 09 22:45:49 user nova-compute[72409]:     <graphics supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sdl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vnc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>spice</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egl-headless</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </graphics>
Aug 09 22:45:49 user nova-compute[72409]:     <video supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='modelType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cirrus</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vmvga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>qxl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>none</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>bochs</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>ramfb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </video>
Aug 09 22:45:49 user nova-compute[72409]:     <hostdev supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='mode'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>subsystem</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='startupPolicy'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>default</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>mandatory</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>requisite</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>optional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='subsysType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pci</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='capsType'/>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='pciBackend'/>
Aug 09 22:45:49 user nova-compute[72409]:     </hostdev>
Aug 09 22:45:49 user nova-compute[72409]:     <rng supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>random</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egd</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>builtin</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </rng>
Aug 09 22:45:49 user nova-compute[72409]:     <filesystem supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='driverType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>path</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>handle</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtiofs</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </filesystem>
Aug 09 22:45:49 user nova-compute[72409]:     <tpm supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-tis</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-crb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>passthrough</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>emulator</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </tpm>
Aug 09 22:45:49 user nova-compute[72409]:   </devices>
Aug 09 22:45:49 user nova-compute[72409]:   <features>
Aug 09 22:45:49 user nova-compute[72409]:     <gic supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     <vmcoreinfo supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <genid supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backingStoreInput supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backup supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <sev supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:   </features>
Aug 09 22:45:49 user nova-compute[72409]: </domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:  {{(pid=72409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 09 22:45:49 user nova-compute[72409]: <domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 22:45:49 user nova-compute[72409]:   <domain>kvm</domain>
Aug 09 22:45:49 user nova-compute[72409]:   <machine>pc-i440fx-6.2</machine>
Aug 09 22:45:49 user nova-compute[72409]:   <arch>x86_64</arch>
Aug 09 22:45:49 user nova-compute[72409]:   <vcpu max='255'/>
Aug 09 22:45:49 user nova-compute[72409]:   <iothreads supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:   <os supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='firmware'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>efi</value>
Aug 09 22:45:49 user nova-compute[72409]:     </enum>
Aug 09 22:45:49 user nova-compute[72409]:     <loader supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>rom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pflash</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='readonly'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>yes</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='secure'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </loader>
Aug 09 22:45:49 user nova-compute[72409]:   </os>
Aug 09 22:45:49 user nova-compute[72409]:   <cpu>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-passthrough' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='hostPassthroughMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>on</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='maximum' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='maximumMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>on</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-model' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <vendor>Intel</vendor>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ss'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='vmx'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='pcid'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='hypervisor'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arat'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='umip'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='md-clear'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='invtsc'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibpb'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibrs'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='rsba'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='erms'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='custom' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>qemu64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>qemu32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>phenom</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>n270</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>kvm64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>kvm32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>coreduo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>core2duo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>athlon</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Westmere</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Snowridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Penryn</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G5</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G4</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Opteron_G1</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Nehalem</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Rome</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Milan</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Dhyana</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cooperlake</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Conroe</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>486</model>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:   </cpu>
Aug 09 22:45:49 user nova-compute[72409]:   <memoryBacking supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='sourceType'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>file</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>anonymous</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>memfd</value>
Aug 09 22:45:49 user nova-compute[72409]:     </enum>
Aug 09 22:45:49 user nova-compute[72409]:   </memoryBacking>
Aug 09 22:45:49 user nova-compute[72409]:   <devices>
Aug 09 22:45:49 user nova-compute[72409]:     <disk supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='diskDevice'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>disk</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cdrom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>floppy</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>lun</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='bus'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>ide</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>fdc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sata</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </disk>
Aug 09 22:45:49 user nova-compute[72409]:     <graphics supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sdl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vnc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>spice</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egl-headless</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </graphics>
Aug 09 22:45:49 user nova-compute[72409]:     <video supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='modelType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cirrus</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vmvga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>qxl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>none</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>bochs</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>ramfb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </video>
Aug 09 22:45:49 user nova-compute[72409]:     <hostdev supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='mode'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>subsystem</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='startupPolicy'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>default</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>mandatory</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>requisite</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>optional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='subsysType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pci</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='capsType'/>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='pciBackend'/>
Aug 09 22:45:49 user nova-compute[72409]:     </hostdev>
Aug 09 22:45:49 user nova-compute[72409]:     <rng supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>random</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egd</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>builtin</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </rng>
Aug 09 22:45:49 user nova-compute[72409]:     <filesystem supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='driverType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>path</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>handle</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtiofs</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </filesystem>
Aug 09 22:45:49 user nova-compute[72409]:     <tpm supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-tis</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-crb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>passthrough</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>emulator</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </tpm>
Aug 09 22:45:49 user nova-compute[72409]:   </devices>
Aug 09 22:45:49 user nova-compute[72409]:   <features>
Aug 09 22:45:49 user nova-compute[72409]:     <gic supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     <vmcoreinfo supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <genid supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backingStoreInput supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backup supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <sev supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:   </features>
Aug 09 22:45:49 user nova-compute[72409]: </domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:  {{(pid=72409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 09 22:45:49 user nova-compute[72409]: <domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 22:45:49 user nova-compute[72409]:   <domain>kvm</domain>
Aug 09 22:45:49 user nova-compute[72409]:   <machine>pc-i440fx-jammy</machine>
Aug 09 22:45:49 user nova-compute[72409]:   <arch>x86_64</arch>
Aug 09 22:45:49 user nova-compute[72409]:   <vcpu max='255'/>
Aug 09 22:45:49 user nova-compute[72409]:   <iothreads supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:   <os supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='firmware'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>efi</value>
Aug 09 22:45:49 user nova-compute[72409]:     </enum>
Aug 09 22:45:49 user nova-compute[72409]:     <loader supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>rom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pflash</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='readonly'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>yes</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='secure'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </loader>
Aug 09 22:45:49 user nova-compute[72409]:   </os>
Aug 09 22:45:49 user nova-compute[72409]:   <cpu>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-passthrough' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='hostPassthroughMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>on</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='maximum' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='maximumMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>on</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-model' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <vendor>Intel</vendor>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ss'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='vmx'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='pcid'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='hypervisor'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arat'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='umip'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='md-clear'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='invtsc'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibpb'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibrs'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='rsba'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='erms'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='custom' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>qemu64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>qemu32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>phenom</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>n270</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>kvm64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>kvm32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>coreduo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>core2duo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>athlon</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Westmere</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Snowridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Penryn</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G5</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G4</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Opteron_G1</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Nehalem</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Rome</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Milan</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Dhyana</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cooperlake</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Conroe</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>486</model>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:   </cpu>
Aug 09 22:45:49 user nova-compute[72409]:   <memoryBacking supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='sourceType'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>file</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>anonymous</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>memfd</value>
Aug 09 22:45:49 user nova-compute[72409]:     </enum>
Aug 09 22:45:49 user nova-compute[72409]:   </memoryBacking>
Aug 09 22:45:49 user nova-compute[72409]:   <devices>
Aug 09 22:45:49 user nova-compute[72409]:     <disk supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='diskDevice'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>disk</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cdrom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>floppy</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>lun</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='bus'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>ide</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>fdc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sata</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </disk>
Aug 09 22:45:49 user nova-compute[72409]:     <graphics supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sdl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vnc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>spice</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egl-headless</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </graphics>
Aug 09 22:45:49 user nova-compute[72409]:     <video supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='modelType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cirrus</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vmvga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>qxl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>none</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>bochs</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>ramfb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </video>
Aug 09 22:45:49 user nova-compute[72409]:     <hostdev supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='mode'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>subsystem</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='startupPolicy'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>default</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>mandatory</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>requisite</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>optional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='subsysType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pci</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='capsType'/>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='pciBackend'/>
Aug 09 22:45:49 user nova-compute[72409]:     </hostdev>
Aug 09 22:45:49 user nova-compute[72409]:     <rng supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>random</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egd</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>builtin</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </rng>
Aug 09 22:45:49 user nova-compute[72409]:     <filesystem supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='driverType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>path</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>handle</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtiofs</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </filesystem>
Aug 09 22:45:49 user nova-compute[72409]:     <tpm supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-tis</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-crb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>passthrough</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>emulator</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </tpm>
Aug 09 22:45:49 user nova-compute[72409]:   </devices>
Aug 09 22:45:49 user nova-compute[72409]:   <features>
Aug 09 22:45:49 user nova-compute[72409]:     <gic supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     <vmcoreinfo supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <genid supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backingStoreInput supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backup supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <sev supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:   </features>
Aug 09 22:45:49 user nova-compute[72409]: </domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:  {{(pid=72409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 09 22:45:49 user nova-compute[72409]: <domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 22:45:49 user nova-compute[72409]:   <domain>kvm</domain>
Aug 09 22:45:49 user nova-compute[72409]:   <machine>pc-q35-jammy</machine>
Aug 09 22:45:49 user nova-compute[72409]:   <arch>x86_64</arch>
Aug 09 22:45:49 user nova-compute[72409]:   <vcpu max='288'/>
Aug 09 22:45:49 user nova-compute[72409]:   <iothreads supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:   <os supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='firmware'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>efi</value>
Aug 09 22:45:49 user nova-compute[72409]:     </enum>
Aug 09 22:45:49 user nova-compute[72409]:     <loader supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>rom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pflash</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='readonly'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>yes</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='secure'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>yes</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>no</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </loader>
Aug 09 22:45:49 user nova-compute[72409]:   </os>
Aug 09 22:45:49 user nova-compute[72409]:   <cpu>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-passthrough' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='hostPassthroughMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>on</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='maximum' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='maximumMigratable'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>on</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>off</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='host-model' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <vendor>Intel</vendor>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ss'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='vmx'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='pcid'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='hypervisor'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arat'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='umip'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='md-clear'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='invtsc'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibpb'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='ibrs'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-stibp'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='rsba'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='erms'/>
Aug 09 22:45:49 user nova-compute[72409]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:     <mode name='custom' supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>qemu64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>qemu32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>phenom</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>pentium</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>n270</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>kvm64</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>kvm32</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>coreduo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>core2duo</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>athlon</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Westmere</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Snowridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Skylake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>SandyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Penryn</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G5</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G4</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G3</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Opteron_G2</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Opteron_G1</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Nehalem</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>IvyBridge</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Icelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Haswell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Rome</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-Milan</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>EPYC</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Dhyana</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cooperlake</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>Conroe</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='no'>Broadwell</model>
Aug 09 22:45:49 user nova-compute[72409]:       <model usable='yes'>486</model>
Aug 09 22:45:49 user nova-compute[72409]:     </mode>
Aug 09 22:45:49 user nova-compute[72409]:   </cpu>
Aug 09 22:45:49 user nova-compute[72409]:   <memoryBacking supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:     <enum name='sourceType'>
Aug 09 22:45:49 user nova-compute[72409]:       <value>file</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>anonymous</value>
Aug 09 22:45:49 user nova-compute[72409]:       <value>memfd</value>
Aug 09 22:45:49 user nova-compute[72409]:     </enum>
Aug 09 22:45:49 user nova-compute[72409]:   </memoryBacking>
Aug 09 22:45:49 user nova-compute[72409]:   <devices>
Aug 09 22:45:49 user nova-compute[72409]:     <disk supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='diskDevice'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>disk</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cdrom</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>floppy</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>lun</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='bus'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>fdc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sata</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </disk>
Aug 09 22:45:49 user nova-compute[72409]:     <graphics supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='type'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>sdl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vnc</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>spice</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egl-headless</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </graphics>
Aug 09 22:45:49 user nova-compute[72409]:     <video supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='modelType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>cirrus</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>vmvga</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>qxl</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>none</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>bochs</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>ramfb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </video>
Aug 09 22:45:49 user nova-compute[72409]:     <hostdev supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='mode'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>subsystem</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='startupPolicy'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>default</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>mandatory</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>requisite</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>optional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='subsysType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>usb</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>pci</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>scsi</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='capsType'/>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='pciBackend'/>
Aug 09 22:45:49 user nova-compute[72409]:     </hostdev>
Aug 09 22:45:49 user nova-compute[72409]:     <rng supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtio-non-transitional</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>random</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>egd</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>builtin</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </rng>
Aug 09 22:45:49 user nova-compute[72409]:     <filesystem supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='driverType'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>path</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>handle</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>virtiofs</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </filesystem>
Aug 09 22:45:49 user nova-compute[72409]:     <tpm supported='yes'>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='model'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-tis</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>tpm-crb</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:       <enum name='backendModel'>
Aug 09 22:45:49 user nova-compute[72409]:         <value>passthrough</value>
Aug 09 22:45:49 user nova-compute[72409]:         <value>emulator</value>
Aug 09 22:45:49 user nova-compute[72409]:       </enum>
Aug 09 22:45:49 user nova-compute[72409]:     </tpm>
Aug 09 22:45:49 user nova-compute[72409]:   </devices>
Aug 09 22:45:49 user nova-compute[72409]:   <features>
Aug 09 22:45:49 user nova-compute[72409]:     <gic supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:     <vmcoreinfo supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <genid supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backingStoreInput supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <backup supported='yes'/>
Aug 09 22:45:49 user nova-compute[72409]:     <sev supported='no'/>
Aug 09 22:45:49 user nova-compute[72409]:   </features>
Aug 09 22:45:49 user nova-compute[72409]: </domainCapabilities>
Aug 09 22:45:49 user nova-compute[72409]:  {{(pid=72409) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72409) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72409) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Checking secure boot support for host arch (x86_64) {{(pid=72409) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 22:45:49 user nova-compute[72409]: INFO nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Secure Boot support detected
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] cpu compare xml: <cpu match="exact">
Aug 09 22:45:49 user nova-compute[72409]:   <model>Nehalem</model>
Aug 09 22:45:49 user nova-compute[72409]: </cpu>
Aug 09 22:45:49 user nova-compute[72409]:  {{(pid=72409) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 09 22:45:49 user nova-compute[72409]: INFO nova.virt.node [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Generated node identity 3270f7d5-46eb-4359-8572-5a68440c59c2
Aug 09 22:45:49 user nova-compute[72409]: INFO nova.virt.node [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Wrote node identity 3270f7d5-46eb-4359-8572-5a68440c59c2 to /opt/stack/data/nova/compute_id
Aug 09 22:45:49 user nova-compute[72409]: WARNING nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Compute nodes ['3270f7d5-46eb-4359-8572-5a68440c59c2'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 09 22:45:49 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 09 22:45:49 user nova-compute[72409]: WARNING nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 22:45:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:45:49 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:45:49 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Hypervisor/Node resource view: name=user free_ram=10869MB free_disk=26.35895538330078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:45:49 user nova-compute[72409]: WARNING nova.compute.resource_tracker [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] No compute node record for user:3270f7d5-46eb-4359-8572-5a68440c59c2: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 3270f7d5-46eb-4359-8572-5a68440c59c2 could not be found.
Aug 09 22:45:49 user nova-compute[72409]: INFO nova.compute.resource_tracker [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Compute node record created for user:user with uuid: 3270f7d5-46eb-4359-8572-5a68440c59c2
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:45:49 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:45:50 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [req-57769e56-c496-4147-9363-c70b6cbdef81] Created resource provider record via placement API for resource provider with UUID 3270f7d5-46eb-4359-8572-5a68440c59c2 and name user.
Aug 09 22:45:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72409) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 09 22:45:50 user nova-compute[72409]: INFO nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] kernel doesn't support AMD SEV
Aug 09 22:45:50 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 22:45:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:45:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Libvirt baseline CPU <cpu>
Aug 09 22:45:50 user nova-compute[72409]:   <arch>x86_64</arch>
Aug 09 22:45:50 user nova-compute[72409]:   <model>Nehalem</model>
Aug 09 22:45:50 user nova-compute[72409]:   <vendor>Intel</vendor>
Aug 09 22:45:50 user nova-compute[72409]:   <topology sockets="6" cores="1" threads="1"/>
Aug 09 22:45:50 user nova-compute[72409]: </cpu>
Aug 09 22:45:50 user nova-compute[72409]:  {{(pid=72409) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 09 22:45:50 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Updated inventory for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 09 22:45:50 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Updating resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 generation from 0 to 1 during operation: update_inventory {{(pid=72409) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 22:45:50 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 22:45:50 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Updating resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 generation from 1 to 2 during operation: update_traits {{(pid=72409) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 22:45:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:45:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:45:50 user nova-compute[72409]: DEBUG nova.service [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Creating RPC server for service compute {{(pid=72409) start /opt/stack/nova/nova/service.py:182}}
Aug 09 22:45:50 user nova-compute[72409]: DEBUG nova.service [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Join ServiceGroup membership for this service compute {{(pid=72409) start /opt/stack/nova/nova/service.py:199}}
Aug 09 22:45:50 user nova-compute[72409]: DEBUG nova.servicegroup.drivers.db [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72409) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 09 22:46:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:46:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:46:40 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:46:41 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:46:41 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:46:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=10247MB free_disk=26.262706756591797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:46:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:46:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:46:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:46:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:46:41 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:46:41 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:46:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:46:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:47:41 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:47:41 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:47:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=10188MB free_disk=26.307891845703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:47:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:47:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:47:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:47:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:47:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 22:47:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 22:47:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:47:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:47:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:48:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:48:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:48:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:48:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:48:40 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:48:41 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:48:41 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:48:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=10179MB free_disk=26.08184814453125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:48:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:48:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:48:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:48:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:48:41 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:48:41 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:48:41 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:48:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:48:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:48:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:48:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:48:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 22:48:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 22:48:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:48:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:48:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:48:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:48:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:48:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:48:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:49:41 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:49:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:49:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:49:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:49:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:49:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:49:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:49:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:49:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:49:42 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:49:43 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:49:43 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:49:43 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=9451MB free_disk=26.104633331298828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:49:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:49:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:49:43 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:49:43 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:49:43 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:49:43 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:49:43 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:49:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:49:44 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:49:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:49:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 22:49:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 22:49:44 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:49:44 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:49:44 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:49:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:49:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "935c4677-a511-4b0e-aef3-57bc036220ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:49:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "935c4677-a511-4b0e-aef3-57bc036220ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:49:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:49:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:49:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:49:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:49:53 user nova-compute[72409]: INFO nova.compute.claims [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Claim successful on node user
Aug 09 22:49:53 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:49:53 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:49:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:49:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:49:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:49:54 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:49:54 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:49:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:49:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:49:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:49:54 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Creating image(s)
Aug 09 22:49:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "/opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:49:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "/opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:49:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "/opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:49:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:49:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:49:54 user nova-compute[72409]: DEBUG nova.policy [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bf771a74e994703bd1ed49add72cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dfbbb5a1d134adba458e9c592f6fada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:49:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e.part --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:49:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e.part --force-share --output=json" returned: 0 in 0.162s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:49:55 user nova-compute[72409]: DEBUG nova.virt.images [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] 1f9d9956-e987-40f0-9bbf-df1fe47ca751 was qcow2, converting to raw {{(pid=72409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 22:49:55 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 22:49:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e.part /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e.converted {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:49:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e.part /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e.converted" returned: 0 in 0.209s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:49:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e.converted --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:49:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e.converted --force-share --output=json" returned: 0 in 0.149s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:49:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.258s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:49:55 user nova-compute[72409]: INFO oslo.privsep.daemon [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpwaoa9dfy/privsep.sock']
Aug 09 22:49:55 user sudo[81543]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpwaoa9dfy/privsep.sock
Aug 09 22:49:55 user sudo[81543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 22:49:57 user sudo[81543]: pam_unix(sudo:session): session closed for user root
Aug 09 22:49:57 user nova-compute[72409]: INFO oslo.privsep.daemon [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Spawned new privsep daemon via rootwrap
Aug 09 22:49:57 user nova-compute[72409]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 22:49:57 user nova-compute[72409]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 22:49:57 user nova-compute[72409]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 09 22:49:57 user nova-compute[72409]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81548
Aug 09 22:49:57 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Successfully created port: 303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.022s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.155s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk 1073741824" returned: 0 in 0.045s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:49:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Cannot resize image /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG nova.objects.instance [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'migration_context' on Instance uuid 935c4677-a511-4b0e-aef3-57bc036220ab {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Ensure instance console log exists: /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "9fce283c-f8da-4dd8-89be-64eba9d8486c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:49:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:49:58 user nova-compute[72409]: INFO nova.compute.claims [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Claim successful on node user
Aug 09 22:49:59 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:49:59 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:49:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:49:59 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Creating image(s)
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "/opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "/opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG nova.policy [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5430655e937042df9acbbb835ad7374c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27add12a1694aca8e1f122407e0fa1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.172s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.147s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk 1073741824" returned: 0 in 0.045s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Successfully updated port: 303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquired lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.128s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:49:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:00 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Cannot resize image /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:50:00 user nova-compute[72409]: DEBUG nova.objects.instance [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lazy-loading 'migration_context' on Instance uuid 9fce283c-f8da-4dd8-89be-64eba9d8486c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:00 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:50:00 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Ensure instance console log exists: /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:50:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:00 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:50:00 user nova-compute[72409]: DEBUG nova.compute.manager [req-7f4a15f5-1e43-4357-877c-0623b6e355ea req-dcc04563-aa32-4f83-8efb-0dc760f91b1e service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Received event network-changed-303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:00 user nova-compute[72409]: DEBUG nova.compute.manager [req-7f4a15f5-1e43-4357-877c-0623b6e355ea req-dcc04563-aa32-4f83-8efb-0dc760f91b1e service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Refreshing instance network info cache due to event network-changed-303157c8-fff1-4396-870a-5178c00f9bbf. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:50:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7f4a15f5-1e43-4357-877c-0623b6e355ea req-dcc04563-aa32-4f83-8efb-0dc760f91b1e service nova] Acquiring lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Updating instance_info_cache with network_info: [{"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Releasing lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Instance network_info: |[{"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7f4a15f5-1e43-4357-877c-0623b6e355ea req-dcc04563-aa32-4f83-8efb-0dc760f91b1e service nova] Acquired lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.network.neutron [req-7f4a15f5-1e43-4357-877c-0623b6e355ea req-dcc04563-aa32-4f83-8efb-0dc760f91b1e service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Refreshing network info cache for port 303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Start _get_guest_xml network_info=[{"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:50:01 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:01 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-935040839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-935040839',id=1,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dfbbb5a1d134adba458e9c592f6fada',ramdisk_id='',reservation_id='r-8u6e2v3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-426575742',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:49:54Z,user_data=None,user_id='8bf771a74e994703bd1ed49add72cd14',uuid=935c4677-a511-4b0e-aef3-57bc036220ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converting VIF {"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b1:a5,bridge_name='br-int',has_traffic_filtering=True,id=303157c8-fff1-4396-870a-5178c00f9bbf,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap303157c8-ff') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.objects.instance [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'pci_devices' on Instance uuid 935c4677-a511-4b0e-aef3-57bc036220ab {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:50:01 user nova-compute[72409]:   <uuid>935c4677-a511-4b0e-aef3-57bc036220ab</uuid>
Aug 09 22:50:01 user nova-compute[72409]:   <name>instance-00000001</name>
Aug 09 22:50:01 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:50:01 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:50:01 user nova-compute[72409]:   <metadata>
Aug 09 22:50:01 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:50:01 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:50:01 user nova-compute[72409]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-935040839</nova:name>
Aug 09 22:50:01 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:50:01</nova:creationTime>
Aug 09 22:50:01 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:50:01 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:50:01 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:50:01 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:50:01 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:50:01 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:50:01 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:50:01 user nova-compute[72409]:       <nova:owner>
Aug 09 22:50:01 user nova-compute[72409]:         <nova:user uuid="8bf771a74e994703bd1ed49add72cd14">tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member</nova:user>
Aug 09 22:50:01 user nova-compute[72409]:         <nova:project uuid="7dfbbb5a1d134adba458e9c592f6fada">tempest-ServerBootFromVolumeStableRescueTest-426575742</nova:project>
Aug 09 22:50:01 user nova-compute[72409]:       </nova:owner>
Aug 09 22:50:01 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:50:01 user nova-compute[72409]:       <nova:ports>
Aug 09 22:50:01 user nova-compute[72409]:         <nova:port uuid="303157c8-fff1-4396-870a-5178c00f9bbf">
Aug 09 22:50:01 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 22:50:01 user nova-compute[72409]:         </nova:port>
Aug 09 22:50:01 user nova-compute[72409]:       </nova:ports>
Aug 09 22:50:01 user nova-compute[72409]:     </nova:instance>
Aug 09 22:50:01 user nova-compute[72409]:   </metadata>
Aug 09 22:50:01 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:50:01 user nova-compute[72409]:     <system>
Aug 09 22:50:01 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:50:01 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:50:01 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:50:01 user nova-compute[72409]:       <entry name="serial">935c4677-a511-4b0e-aef3-57bc036220ab</entry>
Aug 09 22:50:01 user nova-compute[72409]:       <entry name="uuid">935c4677-a511-4b0e-aef3-57bc036220ab</entry>
Aug 09 22:50:01 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:50:01 user nova-compute[72409]:     </system>
Aug 09 22:50:01 user nova-compute[72409]:   </sysinfo>
Aug 09 22:50:01 user nova-compute[72409]:   <os>
Aug 09 22:50:01 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:50:01 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:50:01 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:50:01 user nova-compute[72409]:   </os>
Aug 09 22:50:01 user nova-compute[72409]:   <features>
Aug 09 22:50:01 user nova-compute[72409]:     <acpi/>
Aug 09 22:50:01 user nova-compute[72409]:     <apic/>
Aug 09 22:50:01 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:50:01 user nova-compute[72409]:   </features>
Aug 09 22:50:01 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:50:01 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:50:01 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:50:01 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:50:01 user nova-compute[72409]:   </clock>
Aug 09 22:50:01 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:50:01 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:50:01 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:50:01 user nova-compute[72409]:   </cpu>
Aug 09 22:50:01 user nova-compute[72409]:   <devices>
Aug 09 22:50:01 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:50:01 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:50:01 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk"/>
Aug 09 22:50:01 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:50:01 user nova-compute[72409]:     </disk>
Aug 09 22:50:01 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:50:01 user nova-compute[72409]:       <mac address="fa:16:3e:cd:b1:a5"/>
Aug 09 22:50:01 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:01 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:50:01 user nova-compute[72409]:       <target dev="tap303157c8-ff"/>
Aug 09 22:50:01 user nova-compute[72409]:     </interface>
Aug 09 22:50:01 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:50:01 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/console.log" append="off"/>
Aug 09 22:50:01 user nova-compute[72409]:     </serial>
Aug 09 22:50:01 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:50:01 user nova-compute[72409]:     <video>
Aug 09 22:50:01 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:01 user nova-compute[72409]:     </video>
Aug 09 22:50:01 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:50:01 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:50:01 user nova-compute[72409]:     </rng>
Aug 09 22:50:01 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:50:01 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:50:01 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:50:01 user nova-compute[72409]:     </memballoon>
Aug 09 22:50:01 user nova-compute[72409]:   </devices>
Aug 09 22:50:01 user nova-compute[72409]: </domain>
Aug 09 22:50:01 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-935040839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-935040839',id=1,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dfbbb5a1d134adba458e9c592f6fada',ramdisk_id='',reservation_id='r-8u6e2v3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-426575742',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:49:54Z,user_data=None,user_id='8bf771a74e994703bd1ed49add72cd14',uuid=935c4677-a511-4b0e-aef3-57bc036220ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converting VIF {"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b1:a5,bridge_name='br-int',has_traffic_filtering=True,id=303157c8-fff1-4396-870a-5178c00f9bbf,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap303157c8-ff') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG os_vif [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b1:a5,bridge_name='br-int',has_traffic_filtering=True,id=303157c8-fff1-4396-870a-5178c00f9bbf,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap303157c8-ff') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Created schema index Interface.name {{(pid=72409) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Created schema index Port.name {{(pid=72409) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Created schema index Bridge.name {{(pid=72409) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [POLLOUT] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Successfully created port: b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:50:01 user nova-compute[72409]: INFO oslo.privsep.daemon [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpu_b67blf/privsep.sock']
Aug 09 22:50:01 user sudo[81670]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpu_b67blf/privsep.sock
Aug 09 22:50:01 user sudo[81670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 22:50:02 user nova-compute[72409]: DEBUG nova.network.neutron [req-7f4a15f5-1e43-4357-877c-0623b6e355ea req-dcc04563-aa32-4f83-8efb-0dc760f91b1e service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Updated VIF entry in instance network info cache for port 303157c8-fff1-4396-870a-5178c00f9bbf. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:50:02 user nova-compute[72409]: DEBUG nova.network.neutron [req-7f4a15f5-1e43-4357-877c-0623b6e355ea req-dcc04563-aa32-4f83-8efb-0dc760f91b1e service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Updating instance_info_cache with network_info: [{"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7f4a15f5-1e43-4357-877c-0623b6e355ea req-dcc04563-aa32-4f83-8efb-0dc760f91b1e service nova] Releasing lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:03 user sudo[81670]: pam_unix(sudo:session): session closed for user root
Aug 09 22:50:03 user nova-compute[72409]: INFO oslo.privsep.daemon [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Spawned new privsep daemon via rootwrap
Aug 09 22:50:03 user nova-compute[72409]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 22:50:03 user nova-compute[72409]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 22:50:03 user nova-compute[72409]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 09 22:50:03 user nova-compute[72409]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81675
Aug 09 22:50:03 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Successfully updated port: b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "refresh_cache-9fce283c-f8da-4dd8-89be-64eba9d8486c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquired lock "refresh_cache-9fce283c-f8da-4dd8-89be-64eba9d8486c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-83892b58-55da-420c-a09e-af5ba55ff690 req-f231904e-4ae6-4e6c-b973-557331860bdc service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Received event network-changed-b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-83892b58-55da-420c-a09e-af5ba55ff690 req-f231904e-4ae6-4e6c-b973-557331860bdc service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Refreshing instance network info cache due to event network-changed-b0cf731f-0d1d-4e89-9efb-1a12adba424f. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-83892b58-55da-420c-a09e-af5ba55ff690 req-f231904e-4ae6-4e6c-b973-557331860bdc service nova] Acquiring lock "refresh_cache-9fce283c-f8da-4dd8-89be-64eba9d8486c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap303157c8-ff, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap303157c8-ff, col_values=(('external_ids', {'iface-id': '303157c8-fff1-4396-870a-5178c00f9bbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:b1:a5', 'vm-uuid': '935c4677-a511-4b0e-aef3-57bc036220ab'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:03 user nova-compute[72409]: INFO os_vif [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:b1:a5,bridge_name='br-int',has_traffic_filtering=True,id=303157c8-fff1-4396-870a-5178c00f9bbf,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap303157c8-ff')
Aug 09 22:50:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:50:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] No VIF found with MAC fa:16:3e:cd:b1:a5, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Updating instance_info_cache with network_info: [{"id": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "address": "fa:16:3e:ca:9c:28", "network": {"id": "ef3bb213-7287-443e-b97d-654b3ebcca75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1567428712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27add12a1694aca8e1f122407e0fa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf731f-0d", "ovs_interfaceid": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Releasing lock "refresh_cache-9fce283c-f8da-4dd8-89be-64eba9d8486c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Instance network_info: |[{"id": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "address": "fa:16:3e:ca:9c:28", "network": {"id": "ef3bb213-7287-443e-b97d-654b3ebcca75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1567428712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27add12a1694aca8e1f122407e0fa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf731f-0d", "ovs_interfaceid": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-83892b58-55da-420c-a09e-af5ba55ff690 req-f231904e-4ae6-4e6c-b973-557331860bdc service nova] Acquired lock "refresh_cache-9fce283c-f8da-4dd8-89be-64eba9d8486c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.network.neutron [req-83892b58-55da-420c-a09e-af5ba55ff690 req-f231904e-4ae6-4e6c-b973-557331860bdc service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Refreshing network info cache for port b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Start _get_guest_xml network_info=[{"id": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "address": "fa:16:3e:ca:9c:28", "network": {"id": "ef3bb213-7287-443e-b97d-654b3ebcca75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1567428712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27add12a1694aca8e1f122407e0fa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf731f-0d", "ovs_interfaceid": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:04 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:04 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1376947220',display_name='tempest-DeleteServersTestJSON-server-1376947220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1376947220',id=2,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27add12a1694aca8e1f122407e0fa1f',ramdisk_id='',reservation_id='r-qdghnz4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-965854989',owner_user_name='tempest-DeleteServersTestJSON-965854989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:49:59Z,user_data=None,user_id='5430655e937042df9acbbb835ad7374c',uuid=9fce283c-f8da-4dd8-89be-64eba9d8486c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "address": "fa:16:3e:ca:9c:28", "network": {"id": "ef3bb213-7287-443e-b97d-654b3ebcca75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1567428712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27add12a1694aca8e1f122407e0fa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf731f-0d", "ovs_interfaceid": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Converting VIF {"id": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "address": "fa:16:3e:ca:9c:28", "network": {"id": "ef3bb213-7287-443e-b97d-654b3ebcca75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1567428712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27add12a1694aca8e1f122407e0fa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf731f-0d", "ovs_interfaceid": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:9c:28,bridge_name='br-int',has_traffic_filtering=True,id=b0cf731f-0d1d-4e89-9efb-1a12adba424f,network=Network(ef3bb213-7287-443e-b97d-654b3ebcca75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf731f-0d') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.objects.instance [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fce283c-f8da-4dd8-89be-64eba9d8486c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:50:04 user nova-compute[72409]:   <uuid>9fce283c-f8da-4dd8-89be-64eba9d8486c</uuid>
Aug 09 22:50:04 user nova-compute[72409]:   <name>instance-00000002</name>
Aug 09 22:50:04 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:50:04 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:50:04 user nova-compute[72409]:   <metadata>
Aug 09 22:50:04 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:50:04 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:50:04 user nova-compute[72409]:       <nova:name>tempest-DeleteServersTestJSON-server-1376947220</nova:name>
Aug 09 22:50:04 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:50:04</nova:creationTime>
Aug 09 22:50:04 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:50:04 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:50:04 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:50:04 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:50:04 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:50:04 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:50:04 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:50:04 user nova-compute[72409]:       <nova:owner>
Aug 09 22:50:04 user nova-compute[72409]:         <nova:user uuid="5430655e937042df9acbbb835ad7374c">tempest-DeleteServersTestJSON-965854989-project-member</nova:user>
Aug 09 22:50:04 user nova-compute[72409]:         <nova:project uuid="b27add12a1694aca8e1f122407e0fa1f">tempest-DeleteServersTestJSON-965854989</nova:project>
Aug 09 22:50:04 user nova-compute[72409]:       </nova:owner>
Aug 09 22:50:04 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:50:04 user nova-compute[72409]:       <nova:ports>
Aug 09 22:50:04 user nova-compute[72409]:         <nova:port uuid="b0cf731f-0d1d-4e89-9efb-1a12adba424f">
Aug 09 22:50:04 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 22:50:04 user nova-compute[72409]:         </nova:port>
Aug 09 22:50:04 user nova-compute[72409]:       </nova:ports>
Aug 09 22:50:04 user nova-compute[72409]:     </nova:instance>
Aug 09 22:50:04 user nova-compute[72409]:   </metadata>
Aug 09 22:50:04 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:50:04 user nova-compute[72409]:     <system>
Aug 09 22:50:04 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:50:04 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:50:04 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:50:04 user nova-compute[72409]:       <entry name="serial">9fce283c-f8da-4dd8-89be-64eba9d8486c</entry>
Aug 09 22:50:04 user nova-compute[72409]:       <entry name="uuid">9fce283c-f8da-4dd8-89be-64eba9d8486c</entry>
Aug 09 22:50:04 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:50:04 user nova-compute[72409]:     </system>
Aug 09 22:50:04 user nova-compute[72409]:   </sysinfo>
Aug 09 22:50:04 user nova-compute[72409]:   <os>
Aug 09 22:50:04 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:50:04 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:50:04 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:50:04 user nova-compute[72409]:   </os>
Aug 09 22:50:04 user nova-compute[72409]:   <features>
Aug 09 22:50:04 user nova-compute[72409]:     <acpi/>
Aug 09 22:50:04 user nova-compute[72409]:     <apic/>
Aug 09 22:50:04 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:50:04 user nova-compute[72409]:   </features>
Aug 09 22:50:04 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:50:04 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:50:04 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:50:04 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:50:04 user nova-compute[72409]:   </clock>
Aug 09 22:50:04 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:50:04 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:50:04 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:50:04 user nova-compute[72409]:   </cpu>
Aug 09 22:50:04 user nova-compute[72409]:   <devices>
Aug 09 22:50:04 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:50:04 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:50:04 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk"/>
Aug 09 22:50:04 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:50:04 user nova-compute[72409]:     </disk>
Aug 09 22:50:04 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:50:04 user nova-compute[72409]:       <mac address="fa:16:3e:ca:9c:28"/>
Aug 09 22:50:04 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:04 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:50:04 user nova-compute[72409]:       <target dev="tapb0cf731f-0d"/>
Aug 09 22:50:04 user nova-compute[72409]:     </interface>
Aug 09 22:50:04 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:50:04 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/console.log" append="off"/>
Aug 09 22:50:04 user nova-compute[72409]:     </serial>
Aug 09 22:50:04 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:50:04 user nova-compute[72409]:     <video>
Aug 09 22:50:04 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:04 user nova-compute[72409]:     </video>
Aug 09 22:50:04 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:50:04 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:50:04 user nova-compute[72409]:     </rng>
Aug 09 22:50:04 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:50:04 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:50:04 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:50:04 user nova-compute[72409]:     </memballoon>
Aug 09 22:50:04 user nova-compute[72409]:   </devices>
Aug 09 22:50:04 user nova-compute[72409]: </domain>
Aug 09 22:50:04 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1376947220',display_name='tempest-DeleteServersTestJSON-server-1376947220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1376947220',id=2,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b27add12a1694aca8e1f122407e0fa1f',ramdisk_id='',reservation_id='r-qdghnz4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-965854989',owner_user_name='tempest-DeleteServersTestJSON-965854989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:49:59Z,user_data=None,user_id='5430655e937042df9acbbb835ad7374c',uuid=9fce283c-f8da-4dd8-89be-64eba9d8486c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "address": "fa:16:3e:ca:9c:28", "network": {"id": "ef3bb213-7287-443e-b97d-654b3ebcca75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1567428712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27add12a1694aca8e1f122407e0fa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf731f-0d", "ovs_interfaceid": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Converting VIF {"id": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "address": "fa:16:3e:ca:9c:28", "network": {"id": "ef3bb213-7287-443e-b97d-654b3ebcca75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1567428712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27add12a1694aca8e1f122407e0fa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf731f-0d", "ovs_interfaceid": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:9c:28,bridge_name='br-int',has_traffic_filtering=True,id=b0cf731f-0d1d-4e89-9efb-1a12adba424f,network=Network(ef3bb213-7287-443e-b97d-654b3ebcca75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf731f-0d') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG os_vif [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:9c:28,bridge_name='br-int',has_traffic_filtering=True,id=b0cf731f-0d1d-4e89-9efb-1a12adba424f,network=Network(ef3bb213-7287-443e-b97d-654b3ebcca75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf731f-0d') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0cf731f-0d, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0cf731f-0d, col_values=(('external_ids', {'iface-id': 'b0cf731f-0d1d-4e89-9efb-1a12adba424f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:9c:28', 'vm-uuid': '9fce283c-f8da-4dd8-89be-64eba9d8486c'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:04 user nova-compute[72409]: INFO os_vif [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:9c:28,bridge_name='br-int',has_traffic_filtering=True,id=b0cf731f-0d1d-4e89-9efb-1a12adba424f,network=Network(ef3bb213-7287-443e-b97d-654b3ebcca75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf731f-0d')
Aug 09 22:50:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:50:04 user nova-compute[72409]: INFO nova.compute.claims [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Claim successful on node user
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] No VIF found with MAC fa:16:3e:ca:9c:28, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.network.neutron [req-83892b58-55da-420c-a09e-af5ba55ff690 req-f231904e-4ae6-4e6c-b973-557331860bdc service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Updated VIF entry in instance network info cache for port b0cf731f-0d1d-4e89-9efb-1a12adba424f. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.network.neutron [req-83892b58-55da-420c-a09e-af5ba55ff690 req-f231904e-4ae6-4e6c-b973-557331860bdc service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Updating instance_info_cache with network_info: [{"id": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "address": "fa:16:3e:ca:9c:28", "network": {"id": "ef3bb213-7287-443e-b97d-654b3ebcca75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1567428712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27add12a1694aca8e1f122407e0fa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf731f-0d", "ovs_interfaceid": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-83892b58-55da-420c-a09e-af5ba55ff690 req-f231904e-4ae6-4e6c-b973-557331860bdc service nova] Releasing lock "refresh_cache-9fce283c-f8da-4dd8-89be-64eba9d8486c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:50:04 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:50:04 user nova-compute[72409]: DEBUG nova.policy [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce008676a8de41b8b2ffe79ab31462df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e6764aa794ff29ce4bc213a7def7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:50:05 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Creating image(s)
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "/opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "/opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "/opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.155s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk 1073741824" returned: 0 in 0.053s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.167s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Cannot resize image /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG nova.objects.instance [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'migration_context' on Instance uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Ensure instance console log exists: /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:06 user nova-compute[72409]: DEBUG nova.network.neutron [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Successfully created port: 073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:50:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:06 user nova-compute[72409]: DEBUG nova.compute.manager [req-50fcea7e-ed55-4bb2-a9b8-a4e87e891d9c req-bc4e67cd-ddd6-445b-82c9-bbb4ce2fe206 service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Received event network-vif-plugged-303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-50fcea7e-ed55-4bb2-a9b8-a4e87e891d9c req-bc4e67cd-ddd6-445b-82c9-bbb4ce2fe206 service nova] Acquiring lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-50fcea7e-ed55-4bb2-a9b8-a4e87e891d9c req-bc4e67cd-ddd6-445b-82c9-bbb4ce2fe206 service nova] Lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-50fcea7e-ed55-4bb2-a9b8-a4e87e891d9c req-bc4e67cd-ddd6-445b-82c9-bbb4ce2fe206 service nova] Lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:06 user nova-compute[72409]: DEBUG nova.compute.manager [req-50fcea7e-ed55-4bb2-a9b8-a4e87e891d9c req-bc4e67cd-ddd6-445b-82c9-bbb4ce2fe206 service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] No waiting events found dispatching network-vif-plugged-303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:06 user nova-compute[72409]: WARNING nova.compute.manager [req-50fcea7e-ed55-4bb2-a9b8-a4e87e891d9c req-bc4e67cd-ddd6-445b-82c9-bbb4ce2fe206 service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Received unexpected event network-vif-plugged-303157c8-fff1-4396-870a-5178c00f9bbf for instance with vm_state building and task_state spawning.
Aug 09 22:50:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621408.3155162, 935c4677-a511-4b0e-aef3-57bc036220ab => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:08 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] VM Resumed (Lifecycle Event)
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:50:08 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Instance spawned successfully.
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:50:08 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Instance spawned successfully.
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:08 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621408.3158145, 935c4677-a511-4b0e-aef3-57bc036220ab => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:08 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] VM Started (Lifecycle Event)
Aug 09 22:50:08 user nova-compute[72409]: INFO nova.compute.manager [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Took 14.23 seconds to spawn the instance on the hypervisor.
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:08 user nova-compute[72409]: INFO nova.compute.manager [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Took 9.08 seconds to spawn the instance on the hypervisor.
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:08 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621408.3426988, 9fce283c-f8da-4dd8-89be-64eba9d8486c => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:08 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] VM Resumed (Lifecycle Event)
Aug 09 22:50:08 user nova-compute[72409]: INFO nova.compute.manager [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Took 15.13 seconds to build instance.
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:08 user nova-compute[72409]: INFO nova.compute.manager [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Took 9.98 seconds to build instance.
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621408.3431537, 9fce283c-f8da-4dd8-89be-64eba9d8486c => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:08 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] VM Started (Lifecycle Event)
Aug 09 22:50:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0fdb81fb-8d90-4a7d-a117-e5df3d8e2e00 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "935c4677-a511-4b0e-aef3-57bc036220ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.465s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f9d9452e-7dfb-4b5b-a147-30c2365cc5e9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.104s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-fbc884a9-3723-4f8c-9743-5311099a6c34 req-317955fb-6ee5-4bc6-9571-7330f0bb0ce0 service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Received event network-vif-plugged-303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fbc884a9-3723-4f8c-9743-5311099a6c34 req-317955fb-6ee5-4bc6-9571-7330f0bb0ce0 service nova] Acquiring lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fbc884a9-3723-4f8c-9743-5311099a6c34 req-317955fb-6ee5-4bc6-9571-7330f0bb0ce0 service nova] Lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fbc884a9-3723-4f8c-9743-5311099a6c34 req-317955fb-6ee5-4bc6-9571-7330f0bb0ce0 service nova] Lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-fbc884a9-3723-4f8c-9743-5311099a6c34 req-317955fb-6ee5-4bc6-9571-7330f0bb0ce0 service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] No waiting events found dispatching network-vif-plugged-303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:09 user nova-compute[72409]: WARNING nova.compute.manager [req-fbc884a9-3723-4f8c-9743-5311099a6c34 req-317955fb-6ee5-4bc6-9571-7330f0bb0ce0 service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Received unexpected event network-vif-plugged-303157c8-fff1-4396-870a-5178c00f9bbf for instance with vm_state active and task_state None.
Aug 09 22:50:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Successfully updated port: 073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:50:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquired lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:50:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:50:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Received event network-vif-plugged-b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] Acquiring lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] No waiting events found dispatching network-vif-plugged-b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:11 user nova-compute[72409]: WARNING nova.compute.manager [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Received unexpected event network-vif-plugged-b0cf731f-0d1d-4e89-9efb-1a12adba424f for instance with vm_state active and task_state None.
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-changed-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Refreshing instance network info cache due to event network-changed-073bad5c-1f38-4fb0-b4e9-803dd62fcd34. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] Acquiring lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.network.neutron [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updating instance_info_cache with network_info: [{"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Releasing lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Instance network_info: |[{"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] Acquired lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.network.neutron [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Refreshing network info cache for port 073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Start _get_guest_xml network_info=[{"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:50:11 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:11 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1676089071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1676089071',id=3,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWHyfVpg3Kxrgr/EOJ4QW5vmd6tAAdh2btXYWwwgqJOx2vQ/rfQRRsSJSnaWzEo8tufPFyDQFqxKUWgmDvGwm+DH3CFrgPX/YxaD+rKI415YK3kZVdGh13iXzHTaZN+EA==',key_name='tempest-keypair-996093995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='894e6764aa794ff29ce4bc213a7def7d',ramdisk_id='',reservation_id='r-e05l9tyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-723310053',owner_user_name='tempest-AttachVolumeShelveTestJSON-723310053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce008676a8de41b8b2ffe79ab31462df',uuid=19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converting VIF {"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.objects.instance [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'pci_devices' on Instance uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:50:11 user nova-compute[72409]:   <uuid>19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8</uuid>
Aug 09 22:50:11 user nova-compute[72409]:   <name>instance-00000003</name>
Aug 09 22:50:11 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:50:11 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:50:11 user nova-compute[72409]:   <metadata>
Aug 09 22:50:11 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:50:11 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:50:11 user nova-compute[72409]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1676089071</nova:name>
Aug 09 22:50:11 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:50:11</nova:creationTime>
Aug 09 22:50:11 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:50:11 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:50:11 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:50:11 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:50:11 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:50:11 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:50:11 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:50:11 user nova-compute[72409]:       <nova:owner>
Aug 09 22:50:11 user nova-compute[72409]:         <nova:user uuid="ce008676a8de41b8b2ffe79ab31462df">tempest-AttachVolumeShelveTestJSON-723310053-project-member</nova:user>
Aug 09 22:50:11 user nova-compute[72409]:         <nova:project uuid="894e6764aa794ff29ce4bc213a7def7d">tempest-AttachVolumeShelveTestJSON-723310053</nova:project>
Aug 09 22:50:11 user nova-compute[72409]:       </nova:owner>
Aug 09 22:50:11 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:50:11 user nova-compute[72409]:       <nova:ports>
Aug 09 22:50:11 user nova-compute[72409]:         <nova:port uuid="073bad5c-1f38-4fb0-b4e9-803dd62fcd34">
Aug 09 22:50:11 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 22:50:11 user nova-compute[72409]:         </nova:port>
Aug 09 22:50:11 user nova-compute[72409]:       </nova:ports>
Aug 09 22:50:11 user nova-compute[72409]:     </nova:instance>
Aug 09 22:50:11 user nova-compute[72409]:   </metadata>
Aug 09 22:50:11 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:50:11 user nova-compute[72409]:     <system>
Aug 09 22:50:11 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:50:11 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:50:11 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:50:11 user nova-compute[72409]:       <entry name="serial">19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8</entry>
Aug 09 22:50:11 user nova-compute[72409]:       <entry name="uuid">19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8</entry>
Aug 09 22:50:11 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:50:11 user nova-compute[72409]:     </system>
Aug 09 22:50:11 user nova-compute[72409]:   </sysinfo>
Aug 09 22:50:11 user nova-compute[72409]:   <os>
Aug 09 22:50:11 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:50:11 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:50:11 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:50:11 user nova-compute[72409]:   </os>
Aug 09 22:50:11 user nova-compute[72409]:   <features>
Aug 09 22:50:11 user nova-compute[72409]:     <acpi/>
Aug 09 22:50:11 user nova-compute[72409]:     <apic/>
Aug 09 22:50:11 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:50:11 user nova-compute[72409]:   </features>
Aug 09 22:50:11 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:50:11 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:50:11 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:50:11 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:50:11 user nova-compute[72409]:   </clock>
Aug 09 22:50:11 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:50:11 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:50:11 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:50:11 user nova-compute[72409]:   </cpu>
Aug 09 22:50:11 user nova-compute[72409]:   <devices>
Aug 09 22:50:11 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:50:11 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:50:11 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk"/>
Aug 09 22:50:11 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:50:11 user nova-compute[72409]:     </disk>
Aug 09 22:50:11 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:50:11 user nova-compute[72409]:       <mac address="fa:16:3e:77:5f:b3"/>
Aug 09 22:50:11 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:11 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:50:11 user nova-compute[72409]:       <target dev="tap073bad5c-1f"/>
Aug 09 22:50:11 user nova-compute[72409]:     </interface>
Aug 09 22:50:11 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:50:11 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/console.log" append="off"/>
Aug 09 22:50:11 user nova-compute[72409]:     </serial>
Aug 09 22:50:11 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:50:11 user nova-compute[72409]:     <video>
Aug 09 22:50:11 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:11 user nova-compute[72409]:     </video>
Aug 09 22:50:11 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:50:11 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:50:11 user nova-compute[72409]:     </rng>
Aug 09 22:50:11 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:50:11 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:50:11 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:50:11 user nova-compute[72409]:     </memballoon>
Aug 09 22:50:11 user nova-compute[72409]:   </devices>
Aug 09 22:50:11 user nova-compute[72409]: </domain>
Aug 09 22:50:11 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1676089071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1676089071',id=3,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWHyfVpg3Kxrgr/EOJ4QW5vmd6tAAdh2btXYWwwgqJOx2vQ/rfQRRsSJSnaWzEo8tufPFyDQFqxKUWgmDvGwm+DH3CFrgPX/YxaD+rKI415YK3kZVdGh13iXzHTaZN+EA==',key_name='tempest-keypair-996093995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='894e6764aa794ff29ce4bc213a7def7d',ramdisk_id='',reservation_id='r-e05l9tyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-723310053',owner_user_name='tempest-AttachVolumeShelveTestJSON-723310053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce008676a8de41b8b2ffe79ab31462df',uuid=19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converting VIF {"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG os_vif [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap073bad5c-1f, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap073bad5c-1f, col_values=(('external_ids', {'iface-id': '073bad5c-1f38-4fb0-b4e9-803dd62fcd34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:5f:b3', 'vm-uuid': '19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:11 user nova-compute[72409]: INFO os_vif [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f')
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:50:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] No VIF found with MAC fa:16:3e:77:5f:b3, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:50:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG nova.network.neutron [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updated VIF entry in instance network info cache for port 073bad5c-1f38-4fb0-b4e9-803dd62fcd34. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG nova.network.neutron [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updating instance_info_cache with network_info: [{"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] Releasing lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Received event network-vif-plugged-b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] Acquiring lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] No waiting events found dispatching network-vif-plugged-b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:13 user nova-compute[72409]: WARNING nova.compute.manager [req-63642a83-b8f1-473c-a5d7-7675dc8d8117 req-885e45bf-3d59-4815-8f4b-8d4a9f73879e service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Received unexpected event network-vif-plugged-b0cf731f-0d1d-4e89-9efb-1a12adba424f for instance with vm_state active and task_state None.
Aug 09 22:50:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-ceeb6b3f-de0a-4af6-b102-1b37ab2ca78d req-09d563a8-2584-4bc3-bd79-8294d05f208c service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ceeb6b3f-de0a-4af6-b102-1b37ab2ca78d req-09d563a8-2584-4bc3-bd79-8294d05f208c service nova] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ceeb6b3f-de0a-4af6-b102-1b37ab2ca78d req-09d563a8-2584-4bc3-bd79-8294d05f208c service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ceeb6b3f-de0a-4af6-b102-1b37ab2ca78d req-09d563a8-2584-4bc3-bd79-8294d05f208c service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-ceeb6b3f-de0a-4af6-b102-1b37ab2ca78d req-09d563a8-2584-4bc3-bd79-8294d05f208c service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] No waiting events found dispatching network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:15 user nova-compute[72409]: WARNING nova.compute.manager [req-ceeb6b3f-de0a-4af6-b102-1b37ab2ca78d req-09d563a8-2584-4bc3-bd79-8294d05f208c service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received unexpected event network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 for instance with vm_state building and task_state spawning.
Aug 09 22:50:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621415.8146, 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:15 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] VM Resumed (Lifecycle Event)
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:50:15 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Instance spawned successfully.
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:15 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621415.818477, 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:15 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] VM Started (Lifecycle Event)
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:15 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:15 user nova-compute[72409]: INFO nova.compute.manager [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Took 10.99 seconds to spawn the instance on the hypervisor.
Aug 09 22:50:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:16 user nova-compute[72409]: INFO nova.compute.manager [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Took 11.83 seconds to build instance.
Aug 09 22:50:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bf8e954f-cc7c-42f7-8c21-daf26508c8b4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.962s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-8b70bf6b-28a0-4b7c-9b46-cc4edba11e81 req-e7d86d8a-5dde-4098-bfe1-34e9a5e74642 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8b70bf6b-28a0-4b7c-9b46-cc4edba11e81 req-e7d86d8a-5dde-4098-bfe1-34e9a5e74642 service nova] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8b70bf6b-28a0-4b7c-9b46-cc4edba11e81 req-e7d86d8a-5dde-4098-bfe1-34e9a5e74642 service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8b70bf6b-28a0-4b7c-9b46-cc4edba11e81 req-e7d86d8a-5dde-4098-bfe1-34e9a5e74642 service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-8b70bf6b-28a0-4b7c-9b46-cc4edba11e81 req-e7d86d8a-5dde-4098-bfe1-34e9a5e74642 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] No waiting events found dispatching network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:17 user nova-compute[72409]: WARNING nova.compute.manager [req-8b70bf6b-28a0-4b7c-9b46-cc4edba11e81 req-e7d86d8a-5dde-4098-bfe1-34e9a5e74642 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received unexpected event network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 for instance with vm_state active and task_state None.
Aug 09 22:50:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "5af7f4c7-5937-4b69-831e-941d7de4417d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Acquiring lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:50:21 user nova-compute[72409]: INFO nova.compute.claims [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Claim successful on node user
Aug 09 22:50:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.435s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:50:21 user nova-compute[72409]: INFO nova.compute.claims [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Claim successful on node user
Aug 09 22:50:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:50:21 user nova-compute[72409]: DEBUG nova.network.neutron [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:50:21 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.policy [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5567e41fceda4b8abf8d8d56a8bab9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3700dd59a4548ca8e2ec8dd02ecc6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:50:22 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Creating image(s)
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "/opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "/opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "/opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.212s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.network.neutron [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:50:22 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.206s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk 1073741824" returned: 0 in 0.079s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.policy [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '819be43af30b4457aaee0a715f532b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b22450125f542bba84d7ca1254adc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:50:22 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Creating image(s)
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "/opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "/opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.203s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Cannot resize image /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG nova.objects.instance [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lazy-loading 'migration_context' on Instance uuid 5af7f4c7-5937-4b69-831e-941d7de4417d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Ensure instance console log exists: /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.212s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.155s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk 1073741824" returned: 0 in 0.111s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.165s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Cannot resize image /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG nova.objects.instance [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lazy-loading 'migration_context' on Instance uuid bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Ensure instance console log exists: /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:24 user nova-compute[72409]: DEBUG nova.network.neutron [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Successfully created port: 8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:50:25 user nova-compute[72409]: DEBUG nova.network.neutron [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Successfully created port: 02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:50:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:26 user nova-compute[72409]: DEBUG nova.network.neutron [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Successfully updated port: 8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:50:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "refresh_cache-5af7f4c7-5937-4b69-831e-941d7de4417d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquired lock "refresh_cache-5af7f4c7-5937-4b69-831e-941d7de4417d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:26 user nova-compute[72409]: DEBUG nova.network.neutron [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:50:26 user nova-compute[72409]: DEBUG nova.compute.manager [req-136f23b1-e7ae-423e-b1ca-f8a4779425cd req-2046f375-d077-46d3-8bd3-2781c2cd46ee service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Received event network-changed-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:26 user nova-compute[72409]: DEBUG nova.compute.manager [req-136f23b1-e7ae-423e-b1ca-f8a4779425cd req-2046f375-d077-46d3-8bd3-2781c2cd46ee service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Refreshing instance network info cache due to event network-changed-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:50:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-136f23b1-e7ae-423e-b1ca-f8a4779425cd req-2046f375-d077-46d3-8bd3-2781c2cd46ee service nova] Acquiring lock "refresh_cache-5af7f4c7-5937-4b69-831e-941d7de4417d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:26 user nova-compute[72409]: DEBUG nova.network.neutron [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:50:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "7b252875-ae91-4f8c-ae44-71097f9809a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Successfully updated port: 02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Acquiring lock "refresh_cache-bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Acquired lock "refresh_cache-bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:50:27 user nova-compute[72409]: INFO nova.compute.claims [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Claim successful on node user
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Updating instance_info_cache with network_info: [{"id": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "address": "fa:16:3e:92:55:4d", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eff036f-2f", "ovs_interfaceid": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Releasing lock "refresh_cache-5af7f4c7-5937-4b69-831e-941d7de4417d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Instance network_info: |[{"id": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "address": "fa:16:3e:92:55:4d", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eff036f-2f", "ovs_interfaceid": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-136f23b1-e7ae-423e-b1ca-f8a4779425cd req-2046f375-d077-46d3-8bd3-2781c2cd46ee service nova] Acquired lock "refresh_cache-5af7f4c7-5937-4b69-831e-941d7de4417d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.neutron [req-136f23b1-e7ae-423e-b1ca-f8a4779425cd req-2046f375-d077-46d3-8bd3-2781c2cd46ee service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Refreshing network info cache for port 8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Start _get_guest_xml network_info=[{"id": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "address": "fa:16:3e:92:55:4d", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eff036f-2f", "ovs_interfaceid": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:50:27 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:27 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-212733071',display_name='tempest-VolumesAdminNegativeTest-server-212733071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-212733071',id=4,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6AxoPSiqQoQ50r9M9jKCRoK7PAuLg4UtxRFf5fYuX1lO+yKsORcWJT1yLe+H8BTjaP+9JlKTK4xcqLp3MvzNFfIqlYJl2QXGkUxpsiigugiQeepjLlKsbFYWEwga1P+w==',key_name='tempest-keypair-1388316913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3700dd59a4548ca8e2ec8dd02ecc6a7',ramdisk_id='',reservation_id='r-n2euh8p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-994899237',owner_user_name='tempest-VolumesAdminNegativeTest-994899237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5567e41fceda4b8abf8d8d56a8bab9b2',uuid=5af7f4c7-5937-4b69-831e-941d7de4417d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "address": "fa:16:3e:92:55:4d", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eff036f-2f", "ovs_interfaceid": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Converting VIF {"id": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "address": "fa:16:3e:92:55:4d", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eff036f-2f", "ovs_interfaceid": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:55:4d,bridge_name='br-int',has_traffic_filtering=True,id=8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eff036f-2f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.objects.instance [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lazy-loading 'pci_devices' on Instance uuid 5af7f4c7-5937-4b69-831e-941d7de4417d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:50:27 user nova-compute[72409]:   <uuid>5af7f4c7-5937-4b69-831e-941d7de4417d</uuid>
Aug 09 22:50:27 user nova-compute[72409]:   <name>instance-00000004</name>
Aug 09 22:50:27 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:50:27 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:50:27 user nova-compute[72409]:   <metadata>
Aug 09 22:50:27 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:50:27 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:50:27 user nova-compute[72409]:       <nova:name>tempest-VolumesAdminNegativeTest-server-212733071</nova:name>
Aug 09 22:50:27 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:50:27</nova:creationTime>
Aug 09 22:50:27 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:50:27 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:50:27 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:50:27 user nova-compute[72409]:       <nova:owner>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:user uuid="5567e41fceda4b8abf8d8d56a8bab9b2">tempest-VolumesAdminNegativeTest-994899237-project-member</nova:user>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:project uuid="b3700dd59a4548ca8e2ec8dd02ecc6a7">tempest-VolumesAdminNegativeTest-994899237</nova:project>
Aug 09 22:50:27 user nova-compute[72409]:       </nova:owner>
Aug 09 22:50:27 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:50:27 user nova-compute[72409]:       <nova:ports>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:port uuid="8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d">
Aug 09 22:50:27 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 22:50:27 user nova-compute[72409]:         </nova:port>
Aug 09 22:50:27 user nova-compute[72409]:       </nova:ports>
Aug 09 22:50:27 user nova-compute[72409]:     </nova:instance>
Aug 09 22:50:27 user nova-compute[72409]:   </metadata>
Aug 09 22:50:27 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:50:27 user nova-compute[72409]:     <system>
Aug 09 22:50:27 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:50:27 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:50:27 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:50:27 user nova-compute[72409]:       <entry name="serial">5af7f4c7-5937-4b69-831e-941d7de4417d</entry>
Aug 09 22:50:27 user nova-compute[72409]:       <entry name="uuid">5af7f4c7-5937-4b69-831e-941d7de4417d</entry>
Aug 09 22:50:27 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:50:27 user nova-compute[72409]:     </system>
Aug 09 22:50:27 user nova-compute[72409]:   </sysinfo>
Aug 09 22:50:27 user nova-compute[72409]:   <os>
Aug 09 22:50:27 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:50:27 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:50:27 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:50:27 user nova-compute[72409]:   </os>
Aug 09 22:50:27 user nova-compute[72409]:   <features>
Aug 09 22:50:27 user nova-compute[72409]:     <acpi/>
Aug 09 22:50:27 user nova-compute[72409]:     <apic/>
Aug 09 22:50:27 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:50:27 user nova-compute[72409]:   </features>
Aug 09 22:50:27 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:50:27 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:50:27 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:50:27 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:50:27 user nova-compute[72409]:   </clock>
Aug 09 22:50:27 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:50:27 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:50:27 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:50:27 user nova-compute[72409]:   </cpu>
Aug 09 22:50:27 user nova-compute[72409]:   <devices>
Aug 09 22:50:27 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:50:27 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:50:27 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk"/>
Aug 09 22:50:27 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:50:27 user nova-compute[72409]:     </disk>
Aug 09 22:50:27 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:50:27 user nova-compute[72409]:       <mac address="fa:16:3e:92:55:4d"/>
Aug 09 22:50:27 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:27 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:50:27 user nova-compute[72409]:       <target dev="tap8eff036f-2f"/>
Aug 09 22:50:27 user nova-compute[72409]:     </interface>
Aug 09 22:50:27 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:50:27 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/console.log" append="off"/>
Aug 09 22:50:27 user nova-compute[72409]:     </serial>
Aug 09 22:50:27 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:50:27 user nova-compute[72409]:     <video>
Aug 09 22:50:27 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:27 user nova-compute[72409]:     </video>
Aug 09 22:50:27 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:50:27 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:50:27 user nova-compute[72409]:     </rng>
Aug 09 22:50:27 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:50:27 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:50:27 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:50:27 user nova-compute[72409]:     </memballoon>
Aug 09 22:50:27 user nova-compute[72409]:   </devices>
Aug 09 22:50:27 user nova-compute[72409]: </domain>
Aug 09 22:50:27 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-212733071',display_name='tempest-VolumesAdminNegativeTest-server-212733071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-212733071',id=4,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6AxoPSiqQoQ50r9M9jKCRoK7PAuLg4UtxRFf5fYuX1lO+yKsORcWJT1yLe+H8BTjaP+9JlKTK4xcqLp3MvzNFfIqlYJl2QXGkUxpsiigugiQeepjLlKsbFYWEwga1P+w==',key_name='tempest-keypair-1388316913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3700dd59a4548ca8e2ec8dd02ecc6a7',ramdisk_id='',reservation_id='r-n2euh8p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-994899237',owner_user_name='tempest-VolumesAdminNegativeTest-994899237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5567e41fceda4b8abf8d8d56a8bab9b2',uuid=5af7f4c7-5937-4b69-831e-941d7de4417d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "address": "fa:16:3e:92:55:4d", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eff036f-2f", "ovs_interfaceid": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Converting VIF {"id": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "address": "fa:16:3e:92:55:4d", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eff036f-2f", "ovs_interfaceid": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:55:4d,bridge_name='br-int',has_traffic_filtering=True,id=8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eff036f-2f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG os_vif [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:55:4d,bridge_name='br-int',has_traffic_filtering=True,id=8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eff036f-2f') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eff036f-2f, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8eff036f-2f, col_values=(('external_ids', {'iface-id': '8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:55:4d', 'vm-uuid': '5af7f4c7-5937-4b69-831e-941d7de4417d'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:27 user nova-compute[72409]: INFO os_vif [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:55:4d,bridge_name='br-int',has_traffic_filtering=True,id=8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eff036f-2f')
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:50:27 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] No VIF found with MAC fa:16:3e:92:55:4d, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Updating instance_info_cache with network_info: [{"id": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "address": "fa:16:3e:e0:3a:ad", "network": {"id": "4868dbae-2144-4a2a-aecb-fe9c4f0bc39a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-221632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b22450125f542bba84d7ca1254adc42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02736d2f-5e", "ovs_interfaceid": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Releasing lock "refresh_cache-bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Instance network_info: |[{"id": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "address": "fa:16:3e:e0:3a:ad", "network": {"id": "4868dbae-2144-4a2a-aecb-fe9c4f0bc39a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-221632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b22450125f542bba84d7ca1254adc42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02736d2f-5e", "ovs_interfaceid": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Start _get_guest_xml network_info=[{"id": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "address": "fa:16:3e:e0:3a:ad", "network": {"id": "4868dbae-2144-4a2a-aecb-fe9c4f0bc39a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-221632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b22450125f542bba84d7ca1254adc42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02736d2f-5e", "ovs_interfaceid": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:50:27 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:27 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-631960361',display_name='tempest-VolumesAssistedSnapshotsTest-server-631960361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-631960361',id=5,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHYQvohhzD4xzJdR/Kn/a1xGTYXgAH1A/IPzcOXr339v3C+1Q643bu7CwcK1o8oEILCll27zfvjzKfqokr4GlVTWvW7/rszZZE/vypqhcmjBdq2To29ZYcSym5yy+UhXA==',key_name='tempest-keypair-1932817062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b22450125f542bba84d7ca1254adc42',ramdisk_id='',reservation_id='r-n90anrc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1432548145',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1432548145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='819be43af30b4457aaee0a715f532b7c',uuid=bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "address": "fa:16:3e:e0:3a:ad", "network": {"id": "4868dbae-2144-4a2a-aecb-fe9c4f0bc39a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-221632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b22450125f542bba84d7ca1254adc42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02736d2f-5e", "ovs_interfaceid": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Converting VIF {"id": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "address": "fa:16:3e:e0:3a:ad", "network": {"id": "4868dbae-2144-4a2a-aecb-fe9c4f0bc39a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-221632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b22450125f542bba84d7ca1254adc42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02736d2f-5e", "ovs_interfaceid": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=02736d2f-5ea1-41ca-9570-8e14feb041b1,network=Network(4868dbae-2144-4a2a-aecb-fe9c4f0bc39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02736d2f-5e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.objects.instance [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lazy-loading 'pci_devices' on Instance uuid bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.policy [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fbc4c06b52f4db98f7b9e4b2843a52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df159d250877407ba2a1768c49ebefb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:50:27 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Creating image(s)
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "/opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "/opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "40817a5d57b931ef7a9533f4551f8517b4bec413" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "40817a5d57b931ef7a9533f4551f8517b4bec413" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:50:27 user nova-compute[72409]:   <uuid>bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c</uuid>
Aug 09 22:50:27 user nova-compute[72409]:   <name>instance-00000005</name>
Aug 09 22:50:27 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:50:27 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:50:27 user nova-compute[72409]:   <metadata>
Aug 09 22:50:27 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:50:27 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:50:27 user nova-compute[72409]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-631960361</nova:name>
Aug 09 22:50:27 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:50:27</nova:creationTime>
Aug 09 22:50:27 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:50:27 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:50:27 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:50:27 user nova-compute[72409]:       <nova:owner>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:user uuid="819be43af30b4457aaee0a715f532b7c">tempest-VolumesAssistedSnapshotsTest-1432548145-project-member</nova:user>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:project uuid="4b22450125f542bba84d7ca1254adc42">tempest-VolumesAssistedSnapshotsTest-1432548145</nova:project>
Aug 09 22:50:27 user nova-compute[72409]:       </nova:owner>
Aug 09 22:50:27 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:50:27 user nova-compute[72409]:       <nova:ports>
Aug 09 22:50:27 user nova-compute[72409]:         <nova:port uuid="02736d2f-5ea1-41ca-9570-8e14feb041b1">
Aug 09 22:50:27 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 22:50:27 user nova-compute[72409]:         </nova:port>
Aug 09 22:50:27 user nova-compute[72409]:       </nova:ports>
Aug 09 22:50:27 user nova-compute[72409]:     </nova:instance>
Aug 09 22:50:27 user nova-compute[72409]:   </metadata>
Aug 09 22:50:27 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:50:27 user nova-compute[72409]:     <system>
Aug 09 22:50:27 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:50:27 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:50:27 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:50:27 user nova-compute[72409]:       <entry name="serial">bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c</entry>
Aug 09 22:50:27 user nova-compute[72409]:       <entry name="uuid">bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c</entry>
Aug 09 22:50:27 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:50:27 user nova-compute[72409]:     </system>
Aug 09 22:50:27 user nova-compute[72409]:   </sysinfo>
Aug 09 22:50:27 user nova-compute[72409]:   <os>
Aug 09 22:50:27 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:50:27 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:50:27 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:50:27 user nova-compute[72409]:   </os>
Aug 09 22:50:27 user nova-compute[72409]:   <features>
Aug 09 22:50:27 user nova-compute[72409]:     <acpi/>
Aug 09 22:50:27 user nova-compute[72409]:     <apic/>
Aug 09 22:50:27 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:50:27 user nova-compute[72409]:   </features>
Aug 09 22:50:27 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:50:27 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:50:27 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:50:27 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:50:27 user nova-compute[72409]:   </clock>
Aug 09 22:50:27 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:50:27 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:50:27 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:50:27 user nova-compute[72409]:   </cpu>
Aug 09 22:50:27 user nova-compute[72409]:   <devices>
Aug 09 22:50:27 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:50:27 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:50:27 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk"/>
Aug 09 22:50:27 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:50:27 user nova-compute[72409]:     </disk>
Aug 09 22:50:27 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:50:27 user nova-compute[72409]:       <mac address="fa:16:3e:e0:3a:ad"/>
Aug 09 22:50:27 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:27 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:50:27 user nova-compute[72409]:       <target dev="tap02736d2f-5e"/>
Aug 09 22:50:27 user nova-compute[72409]:     </interface>
Aug 09 22:50:27 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:50:27 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/console.log" append="off"/>
Aug 09 22:50:27 user nova-compute[72409]:     </serial>
Aug 09 22:50:27 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:50:27 user nova-compute[72409]:     <video>
Aug 09 22:50:27 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:27 user nova-compute[72409]:     </video>
Aug 09 22:50:27 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:50:27 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:50:27 user nova-compute[72409]:     </rng>
Aug 09 22:50:27 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:50:27 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:50:27 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:50:27 user nova-compute[72409]:     </memballoon>
Aug 09 22:50:27 user nova-compute[72409]:   </devices>
Aug 09 22:50:27 user nova-compute[72409]: </domain>
Aug 09 22:50:27 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-631960361',display_name='tempest-VolumesAssistedSnapshotsTest-server-631960361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-631960361',id=5,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHYQvohhzD4xzJdR/Kn/a1xGTYXgAH1A/IPzcOXr339v3C+1Q643bu7CwcK1o8oEILCll27zfvjzKfqokr4GlVTWvW7/rszZZE/vypqhcmjBdq2To29ZYcSym5yy+UhXA==',key_name='tempest-keypair-1932817062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b22450125f542bba84d7ca1254adc42',ramdisk_id='',reservation_id='r-n90anrc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1432548145',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1432548145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='819be43af30b4457aaee0a715f532b7c',uuid=bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "address": "fa:16:3e:e0:3a:ad", "network": {"id": "4868dbae-2144-4a2a-aecb-fe9c4f0bc39a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-221632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b22450125f542bba84d7ca1254adc42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02736d2f-5e", "ovs_interfaceid": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Converting VIF {"id": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "address": "fa:16:3e:e0:3a:ad", "network": {"id": "4868dbae-2144-4a2a-aecb-fe9c4f0bc39a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-221632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b22450125f542bba84d7ca1254adc42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02736d2f-5e", "ovs_interfaceid": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=02736d2f-5ea1-41ca-9570-8e14feb041b1,network=Network(4868dbae-2144-4a2a-aecb-fe9c4f0bc39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02736d2f-5e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG os_vif [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=02736d2f-5ea1-41ca-9570-8e14feb041b1,network=Network(4868dbae-2144-4a2a-aecb-fe9c4f0bc39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02736d2f-5e') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02736d2f-5e, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02736d2f-5e, col_values=(('external_ids', {'iface-id': '02736d2f-5ea1-41ca-9570-8e14feb041b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:3a:ad', 'vm-uuid': 'bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:50:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:27 user nova-compute[72409]: INFO os_vif [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=02736d2f-5ea1-41ca-9570-8e14feb041b1,network=Network(4868dbae-2144-4a2a-aecb-fe9c4f0bc39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02736d2f-5e')
Aug 09 22:50:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413.part --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] No VIF found with MAC fa:16:3e:e0:3a:ad, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413.part --force-share --output=json" returned: 0 in 0.159s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG nova.virt.images [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] ef322503-42d9-4dbd-94fe-2f41a6f608ad was qcow2, converting to raw {{(pid=72409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413.part /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413.converted {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-136f23b1-e7ae-423e-b1ca-f8a4779425cd req-2046f375-d077-46d3-8bd3-2781c2cd46ee service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Updated VIF entry in instance network info cache for port 8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-136f23b1-e7ae-423e-b1ca-f8a4779425cd req-2046f375-d077-46d3-8bd3-2781c2cd46ee service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Updating instance_info_cache with network_info: [{"id": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "address": "fa:16:3e:92:55:4d", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eff036f-2f", "ovs_interfaceid": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-136f23b1-e7ae-423e-b1ca-f8a4779425cd req-2046f375-d077-46d3-8bd3-2781c2cd46ee service nova] Releasing lock "refresh_cache-5af7f4c7-5937-4b69-831e-941d7de4417d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413.part /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413.converted" returned: 0 in 0.253s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413.converted --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-7b22f713-ba7e-4a80-a164-a30d3566f684 req-b49a97c9-ddfc-43e8-9095-f39b093c464a service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Received event network-changed-02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-7b22f713-ba7e-4a80-a164-a30d3566f684 req-b49a97c9-ddfc-43e8-9095-f39b093c464a service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Refreshing instance network info cache due to event network-changed-02736d2f-5ea1-41ca-9570-8e14feb041b1. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7b22f713-ba7e-4a80-a164-a30d3566f684 req-b49a97c9-ddfc-43e8-9095-f39b093c464a service nova] Acquiring lock "refresh_cache-bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7b22f713-ba7e-4a80-a164-a30d3566f684 req-b49a97c9-ddfc-43e8-9095-f39b093c464a service nova] Acquired lock "refresh_cache-bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-7b22f713-ba7e-4a80-a164-a30d3566f684 req-b49a97c9-ddfc-43e8-9095-f39b093c464a service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Refreshing network info cache for port 02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413.converted --force-share --output=json" returned: 0 in 0.162s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "40817a5d57b931ef7a9533f4551f8517b4bec413" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.951s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413 --force-share --output=json" returned: 0 in 0.154s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "40817a5d57b931ef7a9533f4551f8517b4bec413" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "40817a5d57b931ef7a9533f4551f8517b4bec413" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413 --force-share --output=json" returned: 0 in 0.156s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413,backing_fmt=raw /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413,backing_fmt=raw /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk 1073741824" returned: 0 in 0.050s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "40817a5d57b931ef7a9533f4551f8517b4bec413" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG nova.network.neutron [req-7b22f713-ba7e-4a80-a164-a30d3566f684 req-b49a97c9-ddfc-43e8-9095-f39b093c464a service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Updated VIF entry in instance network info cache for port 02736d2f-5ea1-41ca-9570-8e14feb041b1. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG nova.network.neutron [req-7b22f713-ba7e-4a80-a164-a30d3566f684 req-b49a97c9-ddfc-43e8-9095-f39b093c464a service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Updating instance_info_cache with network_info: [{"id": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "address": "fa:16:3e:e0:3a:ad", "network": {"id": "4868dbae-2144-4a2a-aecb-fe9c4f0bc39a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-221632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b22450125f542bba84d7ca1254adc42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02736d2f-5e", "ovs_interfaceid": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7b22f713-ba7e-4a80-a164-a30d3566f684 req-b49a97c9-ddfc-43e8-9095-f39b093c464a service nova] Releasing lock "refresh_cache-bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413 --force-share --output=json" returned: 0 in 0.157s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Cannot resize image /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG nova.objects.instance [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lazy-loading 'migration_context' on Instance uuid 7b252875-ae91-4f8c-ae44-71097f9809a2 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Ensure instance console log exists: /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:29 user nova-compute[72409]: DEBUG nova.network.neutron [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Successfully created port: 67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-67ac2d25-da0c-4eca-a0dc-08e2bf475a1c req-074dcaa5-6df8-4bfd-a34c-3670693a40b0 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Received event network-vif-plugged-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-67ac2d25-da0c-4eca-a0dc-08e2bf475a1c req-074dcaa5-6df8-4bfd-a34c-3670693a40b0 service nova] Acquiring lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-67ac2d25-da0c-4eca-a0dc-08e2bf475a1c req-074dcaa5-6df8-4bfd-a34c-3670693a40b0 service nova] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-67ac2d25-da0c-4eca-a0dc-08e2bf475a1c req-074dcaa5-6df8-4bfd-a34c-3670693a40b0 service nova] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-67ac2d25-da0c-4eca-a0dc-08e2bf475a1c req-074dcaa5-6df8-4bfd-a34c-3670693a40b0 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] No waiting events found dispatching network-vif-plugged-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:30 user nova-compute[72409]: WARNING nova.compute.manager [req-67ac2d25-da0c-4eca-a0dc-08e2bf475a1c req-074dcaa5-6df8-4bfd-a34c-3670693a40b0 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Received unexpected event network-vif-plugged-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d for instance with vm_state building and task_state spawning.
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:31 user nova-compute[72409]: DEBUG nova.network.neutron [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Successfully updated port: 67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:50:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "refresh_cache-7b252875-ae91-4f8c-ae44-71097f9809a2" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquired lock "refresh_cache-7b252875-ae91-4f8c-ae44-71097f9809a2" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:31 user nova-compute[72409]: DEBUG nova.network.neutron [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG nova.network.neutron [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Received event network-vif-plugged-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] Acquiring lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] No waiting events found dispatching network-vif-plugged-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:32 user nova-compute[72409]: WARNING nova.compute.manager [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Received unexpected event network-vif-plugged-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d for instance with vm_state building and task_state spawning.
Aug 09 22:50:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Received event network-changed-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Refreshing instance network info cache due to event network-changed-67bb13f5-76f3-4cc6-98c8-27caf4a1f140. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] Acquiring lock "refresh_cache-7b252875-ae91-4f8c-ae44-71097f9809a2" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG nova.network.neutron [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Updating instance_info_cache with network_info: [{"id": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "address": "fa:16:3e:8b:4b:f3", "network": {"id": "6a82d39a-e6ee-42ed-8588-8400f18cee5a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-617297362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df159d250877407ba2a1768c49ebefb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bb13f5-76", "ovs_interfaceid": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Releasing lock "refresh_cache-7b252875-ae91-4f8c-ae44-71097f9809a2" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Instance network_info: |[{"id": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "address": "fa:16:3e:8b:4b:f3", "network": {"id": "6a82d39a-e6ee-42ed-8588-8400f18cee5a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-617297362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df159d250877407ba2a1768c49ebefb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bb13f5-76", "ovs_interfaceid": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] Acquired lock "refresh_cache-7b252875-ae91-4f8c-ae44-71097f9809a2" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG nova.network.neutron [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Refreshing network info cache for port 67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:50:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Start _get_guest_xml network_info=[{"id": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "address": "fa:16:3e:8b:4b:f3", "network": {"id": "6a82d39a-e6ee-42ed-8588-8400f18cee5a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-617297362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df159d250877407ba2a1768c49ebefb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bb13f5-76", "ovs_interfaceid": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:50:18Z,direct_url=<?>,disk_format='qcow2',id=ef322503-42d9-4dbd-94fe-2f41a6f608ad,min_disk=0,min_ram=0,name='',owner='74b1def1df6a4e359e55407101c64c4a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:50:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'scsi', 'guest_format': None, 'image_id': 'ef322503-42d9-4dbd-94fe-2f41a6f608ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:50:33 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:33 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:50:18Z,direct_url=<?>,disk_format='qcow2',id=ef322503-42d9-4dbd-94fe-2f41a6f608ad,min_disk=0,min_ram=0,name='',owner='74b1def1df6a4e359e55407101c64c4a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:50:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1735458139',display_name='tempest-AttachSCSIVolumeTestJSON-server-1735458139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1735458139',id=6,image_ref='ef322503-42d9-4dbd-94fe-2f41a6f608ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPG0+2NT+f/U0hWtxChf3P2unNM+gLutfYMAYfreX/5EuDllcH2h9Zxbq32l4Sw+9dtuGa4+AGppOxPefDi3LUA20DOlpELoFrmOwsPYjmggpMvPHr3hAwgb0Qi+N3ZaA==',key_name='tempest-keypair-126976649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df159d250877407ba2a1768c49ebefb0',ramdisk_id='',reservation_id='r-1vda10hg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ef322503-42d9-4dbd-94fe-2f41a6f608ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-9083404',owner_user_name='tempest-AttachSCSIVolumeTestJSON-9083404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fbc4c06b52f4db98f7b9e4b2843a52c',uuid=7b252875-ae91-4f8c-ae44-71097f9809a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "address": "fa:16:3e:8b:4b:f3", "network": {"id": "6a82d39a-e6ee-42ed-8588-8400f18cee5a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-617297362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df159d250877407ba2a1768c49ebefb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bb13f5-76", "ovs_interfaceid": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Converting VIF {"id": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "address": "fa:16:3e:8b:4b:f3", "network": {"id": "6a82d39a-e6ee-42ed-8588-8400f18cee5a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-617297362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df159d250877407ba2a1768c49ebefb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bb13f5-76", "ovs_interfaceid": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:4b:f3,bridge_name='br-int',has_traffic_filtering=True,id=67bb13f5-76f3-4cc6-98c8-27caf4a1f140,network=Network(6a82d39a-e6ee-42ed-8588-8400f18cee5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bb13f5-76') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.objects.instance [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b252875-ae91-4f8c-ae44-71097f9809a2 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:50:33 user nova-compute[72409]:   <uuid>7b252875-ae91-4f8c-ae44-71097f9809a2</uuid>
Aug 09 22:50:33 user nova-compute[72409]:   <name>instance-00000006</name>
Aug 09 22:50:33 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:50:33 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:50:33 user nova-compute[72409]:   <metadata>
Aug 09 22:50:33 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:50:33 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:50:33 user nova-compute[72409]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1735458139</nova:name>
Aug 09 22:50:33 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:50:33</nova:creationTime>
Aug 09 22:50:33 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:50:33 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:50:33 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:50:33 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:50:33 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:50:33 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:50:33 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:50:33 user nova-compute[72409]:       <nova:owner>
Aug 09 22:50:33 user nova-compute[72409]:         <nova:user uuid="9fbc4c06b52f4db98f7b9e4b2843a52c">tempest-AttachSCSIVolumeTestJSON-9083404-project-member</nova:user>
Aug 09 22:50:33 user nova-compute[72409]:         <nova:project uuid="df159d250877407ba2a1768c49ebefb0">tempest-AttachSCSIVolumeTestJSON-9083404</nova:project>
Aug 09 22:50:33 user nova-compute[72409]:       </nova:owner>
Aug 09 22:50:33 user nova-compute[72409]:       <nova:root type="image" uuid="ef322503-42d9-4dbd-94fe-2f41a6f608ad"/>
Aug 09 22:50:33 user nova-compute[72409]:       <nova:ports>
Aug 09 22:50:33 user nova-compute[72409]:         <nova:port uuid="67bb13f5-76f3-4cc6-98c8-27caf4a1f140">
Aug 09 22:50:33 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 22:50:33 user nova-compute[72409]:         </nova:port>
Aug 09 22:50:33 user nova-compute[72409]:       </nova:ports>
Aug 09 22:50:33 user nova-compute[72409]:     </nova:instance>
Aug 09 22:50:33 user nova-compute[72409]:   </metadata>
Aug 09 22:50:33 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:50:33 user nova-compute[72409]:     <system>
Aug 09 22:50:33 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:50:33 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:50:33 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:50:33 user nova-compute[72409]:       <entry name="serial">7b252875-ae91-4f8c-ae44-71097f9809a2</entry>
Aug 09 22:50:33 user nova-compute[72409]:       <entry name="uuid">7b252875-ae91-4f8c-ae44-71097f9809a2</entry>
Aug 09 22:50:33 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:50:33 user nova-compute[72409]:     </system>
Aug 09 22:50:33 user nova-compute[72409]:   </sysinfo>
Aug 09 22:50:33 user nova-compute[72409]:   <os>
Aug 09 22:50:33 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:50:33 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:50:33 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:50:33 user nova-compute[72409]:   </os>
Aug 09 22:50:33 user nova-compute[72409]:   <features>
Aug 09 22:50:33 user nova-compute[72409]:     <acpi/>
Aug 09 22:50:33 user nova-compute[72409]:     <apic/>
Aug 09 22:50:33 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:50:33 user nova-compute[72409]:   </features>
Aug 09 22:50:33 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:50:33 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:50:33 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:50:33 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:50:33 user nova-compute[72409]:   </clock>
Aug 09 22:50:33 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:50:33 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:50:33 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:50:33 user nova-compute[72409]:   </cpu>
Aug 09 22:50:33 user nova-compute[72409]:   <devices>
Aug 09 22:50:33 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:50:33 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:50:33 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk"/>
Aug 09 22:50:33 user nova-compute[72409]:       <target dev="sda" bus="scsi"/>
Aug 09 22:50:33 user nova-compute[72409]:       <address type="drive" controller="0" unit="0"/>
Aug 09 22:50:33 user nova-compute[72409]:     </disk>
Aug 09 22:50:33 user nova-compute[72409]:     <disk type="file" device="cdrom">
Aug 09 22:50:33 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 22:50:33 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk.config"/>
Aug 09 22:50:33 user nova-compute[72409]:       <target dev="sdb" bus="scsi"/>
Aug 09 22:50:33 user nova-compute[72409]:       <address type="drive" controller="0" unit="1"/>
Aug 09 22:50:33 user nova-compute[72409]:     </disk>
Aug 09 22:50:33 user nova-compute[72409]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 09 22:50:33 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:50:33 user nova-compute[72409]:       <mac address="fa:16:3e:8b:4b:f3"/>
Aug 09 22:50:33 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:33 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:50:33 user nova-compute[72409]:       <target dev="tap67bb13f5-76"/>
Aug 09 22:50:33 user nova-compute[72409]:     </interface>
Aug 09 22:50:33 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:50:33 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/console.log" append="off"/>
Aug 09 22:50:33 user nova-compute[72409]:     </serial>
Aug 09 22:50:33 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:50:33 user nova-compute[72409]:     <video>
Aug 09 22:50:33 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:33 user nova-compute[72409]:     </video>
Aug 09 22:50:33 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:50:33 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:50:33 user nova-compute[72409]:     </rng>
Aug 09 22:50:33 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:50:33 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:50:33 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:50:33 user nova-compute[72409]:     </memballoon>
Aug 09 22:50:33 user nova-compute[72409]:   </devices>
Aug 09 22:50:33 user nova-compute[72409]: </domain>
Aug 09 22:50:33 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1735458139',display_name='tempest-AttachSCSIVolumeTestJSON-server-1735458139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1735458139',id=6,image_ref='ef322503-42d9-4dbd-94fe-2f41a6f608ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPG0+2NT+f/U0hWtxChf3P2unNM+gLutfYMAYfreX/5EuDllcH2h9Zxbq32l4Sw+9dtuGa4+AGppOxPefDi3LUA20DOlpELoFrmOwsPYjmggpMvPHr3hAwgb0Qi+N3ZaA==',key_name='tempest-keypair-126976649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df159d250877407ba2a1768c49ebefb0',ramdisk_id='',reservation_id='r-1vda10hg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ef322503-42d9-4dbd-94fe-2f41a6f608ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-9083404',owner_user_name='tempest-AttachSCSIVolumeTestJSON-9083404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fbc4c06b52f4db98f7b9e4b2843a52c',uuid=7b252875-ae91-4f8c-ae44-71097f9809a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "address": "fa:16:3e:8b:4b:f3", "network": {"id": "6a82d39a-e6ee-42ed-8588-8400f18cee5a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-617297362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df159d250877407ba2a1768c49ebefb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bb13f5-76", "ovs_interfaceid": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Converting VIF {"id": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "address": "fa:16:3e:8b:4b:f3", "network": {"id": "6a82d39a-e6ee-42ed-8588-8400f18cee5a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-617297362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df159d250877407ba2a1768c49ebefb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bb13f5-76", "ovs_interfaceid": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:4b:f3,bridge_name='br-int',has_traffic_filtering=True,id=67bb13f5-76f3-4cc6-98c8-27caf4a1f140,network=Network(6a82d39a-e6ee-42ed-8588-8400f18cee5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bb13f5-76') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG os_vif [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:4b:f3,bridge_name='br-int',has_traffic_filtering=True,id=67bb13f5-76f3-4cc6-98c8-27caf4a1f140,network=Network(6a82d39a-e6ee-42ed-8588-8400f18cee5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bb13f5-76') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67bb13f5-76, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67bb13f5-76, col_values=(('external_ids', {'iface-id': '67bb13f5-76f3-4cc6-98c8-27caf4a1f140', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:4b:f3', 'vm-uuid': '7b252875-ae91-4f8c-ae44-71097f9809a2'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:33 user nova-compute[72409]: INFO os_vif [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:4b:f3,bridge_name='br-int',has_traffic_filtering=True,id=67bb13f5-76f3-4cc6-98c8-27caf4a1f140,network=Network(6a82d39a-e6ee-42ed-8588-8400f18cee5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bb13f5-76')
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] No BDM found with device name sda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] No VIF found with MAC fa:16:3e:8b:4b:f3, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Using config drive
Aug 09 22:50:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Creating config drive at /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk.config
Aug 09 22:50:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvutdk8ze {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621433.54774, bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] VM Resumed (Lifecycle Event)
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvutdk8ze" returned: 0 in 0.052s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Instance spawned successfully.
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Instance spawned successfully.
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621433.548313, bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] VM Started (Lifecycle Event)
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.network.neutron [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Updated VIF entry in instance network info cache for port 67bb13f5-76f3-4cc6-98c8-27caf4a1f140. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.network.neutron [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Updating instance_info_cache with network_info: [{"id": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "address": "fa:16:3e:8b:4b:f3", "network": {"id": "6a82d39a-e6ee-42ed-8588-8400f18cee5a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-617297362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df159d250877407ba2a1768c49ebefb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bb13f5-76", "ovs_interfaceid": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] Releasing lock "refresh_cache-7b252875-ae91-4f8c-ae44-71097f9809a2" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Received event network-vif-plugged-02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] Acquiring lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] No waiting events found dispatching network-vif-plugged-02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:33 user nova-compute[72409]: WARNING nova.compute.manager [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Received unexpected event network-vif-plugged-02736d2f-5ea1-41ca-9570-8e14feb041b1 for instance with vm_state building and task_state spawning.
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Received event network-vif-plugged-02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] Acquiring lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] No waiting events found dispatching network-vif-plugged-02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:33 user nova-compute[72409]: WARNING nova.compute.manager [req-84582db5-89dc-4e71-ba7c-3e440a15e806 req-91d128a8-d8a9-41fe-975d-e151c3a5cc49 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Received unexpected event network-vif-plugged-02736d2f-5ea1-41ca-9570-8e14feb041b1 for instance with vm_state building and task_state spawning.
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621433.548816, 5af7f4c7-5937-4b69-831e-941d7de4417d => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] VM Resumed (Lifecycle Event)
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.compute.manager [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Took 11.59 seconds to spawn the instance on the hypervisor.
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.compute.manager [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Took 10.94 seconds to spawn the instance on the hypervisor.
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621433.5488946, 5af7f4c7-5937-4b69-831e-941d7de4417d => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] VM Started (Lifecycle Event)
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.compute.manager [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Took 12.83 seconds to build instance.
Aug 09 22:50:33 user nova-compute[72409]: INFO nova.compute.manager [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Took 12.63 seconds to build instance.
Aug 09 22:50:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aeca6215-f6c0-4c9b-805e-e50528415fb4 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.027s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e8ce9bf1-277e-4840-86d2-1f7b474d75ed tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.885s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:50:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:50:34 user nova-compute[72409]: INFO nova.compute.claims [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Claim successful on node user
Aug 09 22:50:34 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:50:34 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:50:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG nova.network.neutron [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:50:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:50:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG nova.policy [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25c4618cd6154fc6a3205d0b42f5a0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ab01b4b8ef44a3b303aca035f69503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:50:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Creating image(s)
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.239s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Acquiring lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.173s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk 1073741824" returned: 0 in 0.091s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-43a1ddcd-a995-44dc-a738-9530d5e6ae78 req-ca46ca35-187d-47bf-b87d-60761982ed50 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Received event network-vif-plugged-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-43a1ddcd-a995-44dc-a738-9530d5e6ae78 req-ca46ca35-187d-47bf-b87d-60761982ed50 service nova] Acquiring lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-43a1ddcd-a995-44dc-a738-9530d5e6ae78 req-ca46ca35-187d-47bf-b87d-60761982ed50 service nova] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-43a1ddcd-a995-44dc-a738-9530d5e6ae78 req-ca46ca35-187d-47bf-b87d-60761982ed50 service nova] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-43a1ddcd-a995-44dc-a738-9530d5e6ae78 req-ca46ca35-187d-47bf-b87d-60761982ed50 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] No waiting events found dispatching network-vif-plugged-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:36 user nova-compute[72409]: WARNING nova.compute.manager [req-43a1ddcd-a995-44dc-a738-9530d5e6ae78 req-ca46ca35-187d-47bf-b87d-60761982ed50 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Received unexpected event network-vif-plugged-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 for instance with vm_state building and task_state spawning.
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:50:36 user nova-compute[72409]: INFO nova.compute.claims [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Claim successful on node user
Aug 09 22:50:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.212s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Cannot resize image /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.objects.instance [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lazy-loading 'migration_context' on Instance uuid 7297de80-2674-4d9e-88e7-7a809bcf7381 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Ensure instance console log exists: /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.network.neutron [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Successfully created port: 8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.773s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.compute.manager [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.672s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:50:36 user nova-compute[72409]: INFO nova.compute.claims [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Claim successful on node user
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.compute.manager [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.network.neutron [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:50:36 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:50:36 user nova-compute[72409]: DEBUG nova.compute.manager [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.policy [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9c4bf079af74145823bf7023dc03e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c901cd7c354ef3995541c399ad6b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:50:37 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Creating image(s)
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Acquiring lock "/opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "/opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "/opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.176s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.181s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk 1073741824" returned: 0 in 0.185s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.928s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Successfully updated port: 8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Checking if we can resize image /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquired lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-ed554268-feef-431a-8b55-24093c1b800d req-fdf13c12-966c-4daa-8a1b-8721feb49259 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-changed-8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-ed554268-feef-431a-8b55-24093c1b800d req-fdf13c12-966c-4daa-8a1b-8721feb49259 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Refreshing instance network info cache due to event network-changed-8c4beea2-41b0-4bf4-be54-170aa75d060a. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ed554268-feef-431a-8b55-24093c1b800d req-fdf13c12-966c-4daa-8a1b-8721feb49259 service nova] Acquiring lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621437.869637, 7b252875-ae91-4f8c-ae44-71097f9809a2 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:37 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] VM Resumed (Lifecycle Event)
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Successfully created port: 3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:50:37 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:37 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Instance spawned successfully.
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:50:37 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621437.8733666, 7b252875-ae91-4f8c-ae44-71097f9809a2 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:37 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] VM Started (Lifecycle Event)
Aug 09 22:50:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Cannot resize image /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.objects.instance [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lazy-loading 'migration_context' on Instance uuid 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Ensure instance console log exists: /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:38 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.policy [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df4e2dfc7c744b4d8ee4f285cbd6861e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9bd4aed4e4c43cb9e3096f4f3757776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-7491addc-f5b1-4853-86ad-26fdf88df9bb req-41589951-a6a2-4b2f-b05c-3b4dac94b41d service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Received event network-vif-plugged-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7491addc-f5b1-4853-86ad-26fdf88df9bb req-41589951-a6a2-4b2f-b05c-3b4dac94b41d service nova] Acquiring lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7491addc-f5b1-4853-86ad-26fdf88df9bb req-41589951-a6a2-4b2f-b05c-3b4dac94b41d service nova] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7491addc-f5b1-4853-86ad-26fdf88df9bb req-41589951-a6a2-4b2f-b05c-3b4dac94b41d service nova] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-7491addc-f5b1-4853-86ad-26fdf88df9bb req-41589951-a6a2-4b2f-b05c-3b4dac94b41d service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] No waiting events found dispatching network-vif-plugged-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:38 user nova-compute[72409]: WARNING nova.compute.manager [req-7491addc-f5b1-4853-86ad-26fdf88df9bb req-41589951-a6a2-4b2f-b05c-3b4dac94b41d service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Received unexpected event network-vif-plugged-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 for instance with vm_state building and task_state spawning.
Aug 09 22:50:38 user nova-compute[72409]: INFO nova.compute.manager [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Took 10.25 seconds to spawn the instance on the hypervisor.
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:50:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Creating image(s)
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "/opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "/opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:38 user nova-compute[72409]: INFO nova.compute.manager [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Took 11.24 seconds to build instance.
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.147s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-103e0d78-c4ed-43d3-a209-0d0a31136924 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.536s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.network.neutron [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Updating instance_info_cache with network_info: [{"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.186s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Releasing lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Instance network_info: |[{"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ed554268-feef-431a-8b55-24093c1b800d req-fdf13c12-966c-4daa-8a1b-8721feb49259 service nova] Acquired lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.network.neutron [req-ed554268-feef-431a-8b55-24093c1b800d req-fdf13c12-966c-4daa-8a1b-8721feb49259 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Refreshing network info cache for port 8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Start _get_guest_xml network_info=[{"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk 1073741824" returned: 0 in 0.074s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:38 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:38 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850058011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850058011',id=7,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRPOKUNKx5r99nfeKMhpfm/VZ7AykvwNHlx19s63HAGjMBCMer6PwKksiSdO/uCgcrPPCs4Mdvnww76K8FCrlZ8SSpOgbs2r8XIKgBv2t3yYVeYOMw4Yjg1wzdcpPxGXQ==',key_name='tempest-keypair-1164357353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5ab01b4b8ef44a3b303aca035f69503',ramdisk_id='',reservation_id='r-mufx0for',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-12735973',owner_user_name='tempest-TaggedAttachmentsTest-12735973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c4618cd6154fc6a3205d0b42f5a0f4',uuid=7297de80-2674-4d9e-88e7-7a809bcf7381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converting VIF {"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:38:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c4beea2-41b0-4bf4-be54-170aa75d060a,network=Network(5800b5ee-380b-46ff-83a8-ac91596f1efb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4beea2-41') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.objects.instance [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lazy-loading 'pci_devices' on Instance uuid 7297de80-2674-4d9e-88e7-7a809bcf7381 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:50:38 user nova-compute[72409]:   <uuid>7297de80-2674-4d9e-88e7-7a809bcf7381</uuid>
Aug 09 22:50:38 user nova-compute[72409]:   <name>instance-00000007</name>
Aug 09 22:50:38 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:50:38 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:50:38 user nova-compute[72409]:   <metadata>
Aug 09 22:50:38 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:50:38 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:50:38 user nova-compute[72409]:       <nova:name>tempest-device-tagging-server-850058011</nova:name>
Aug 09 22:50:38 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:50:38</nova:creationTime>
Aug 09 22:50:38 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:50:38 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:50:38 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:50:38 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:50:38 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:50:38 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:50:38 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:50:38 user nova-compute[72409]:       <nova:owner>
Aug 09 22:50:38 user nova-compute[72409]:         <nova:user uuid="25c4618cd6154fc6a3205d0b42f5a0f4">tempest-TaggedAttachmentsTest-12735973-project-member</nova:user>
Aug 09 22:50:38 user nova-compute[72409]:         <nova:project uuid="c5ab01b4b8ef44a3b303aca035f69503">tempest-TaggedAttachmentsTest-12735973</nova:project>
Aug 09 22:50:38 user nova-compute[72409]:       </nova:owner>
Aug 09 22:50:38 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:50:38 user nova-compute[72409]:       <nova:ports>
Aug 09 22:50:38 user nova-compute[72409]:         <nova:port uuid="8c4beea2-41b0-4bf4-be54-170aa75d060a">
Aug 09 22:50:38 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 22:50:38 user nova-compute[72409]:         </nova:port>
Aug 09 22:50:38 user nova-compute[72409]:       </nova:ports>
Aug 09 22:50:38 user nova-compute[72409]:     </nova:instance>
Aug 09 22:50:38 user nova-compute[72409]:   </metadata>
Aug 09 22:50:38 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:50:38 user nova-compute[72409]:     <system>
Aug 09 22:50:38 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:50:38 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:50:38 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:50:38 user nova-compute[72409]:       <entry name="serial">7297de80-2674-4d9e-88e7-7a809bcf7381</entry>
Aug 09 22:50:38 user nova-compute[72409]:       <entry name="uuid">7297de80-2674-4d9e-88e7-7a809bcf7381</entry>
Aug 09 22:50:38 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:50:38 user nova-compute[72409]:     </system>
Aug 09 22:50:38 user nova-compute[72409]:   </sysinfo>
Aug 09 22:50:38 user nova-compute[72409]:   <os>
Aug 09 22:50:38 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:50:38 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:50:38 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:50:38 user nova-compute[72409]:   </os>
Aug 09 22:50:38 user nova-compute[72409]:   <features>
Aug 09 22:50:38 user nova-compute[72409]:     <acpi/>
Aug 09 22:50:38 user nova-compute[72409]:     <apic/>
Aug 09 22:50:38 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:50:38 user nova-compute[72409]:   </features>
Aug 09 22:50:38 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:50:38 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:50:38 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:50:38 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:50:38 user nova-compute[72409]:   </clock>
Aug 09 22:50:38 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:50:38 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:50:38 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:50:38 user nova-compute[72409]:   </cpu>
Aug 09 22:50:38 user nova-compute[72409]:   <devices>
Aug 09 22:50:38 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:50:38 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:50:38 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk"/>
Aug 09 22:50:38 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:50:38 user nova-compute[72409]:     </disk>
Aug 09 22:50:38 user nova-compute[72409]:     <disk type="file" device="cdrom">
Aug 09 22:50:38 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 22:50:38 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk.config"/>
Aug 09 22:50:38 user nova-compute[72409]:       <target dev="hda" bus="ide"/>
Aug 09 22:50:38 user nova-compute[72409]:     </disk>
Aug 09 22:50:38 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:50:38 user nova-compute[72409]:       <mac address="fa:16:3e:1b:38:d8"/>
Aug 09 22:50:38 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:38 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:50:38 user nova-compute[72409]:       <target dev="tap8c4beea2-41"/>
Aug 09 22:50:38 user nova-compute[72409]:     </interface>
Aug 09 22:50:38 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:50:38 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/console.log" append="off"/>
Aug 09 22:50:38 user nova-compute[72409]:     </serial>
Aug 09 22:50:38 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:50:38 user nova-compute[72409]:     <video>
Aug 09 22:50:38 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:38 user nova-compute[72409]:     </video>
Aug 09 22:50:38 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:50:38 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:50:38 user nova-compute[72409]:     </rng>
Aug 09 22:50:38 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:50:38 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:50:38 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:50:38 user nova-compute[72409]:     </memballoon>
Aug 09 22:50:38 user nova-compute[72409]:   </devices>
Aug 09 22:50:38 user nova-compute[72409]: </domain>
Aug 09 22:50:38 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850058011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850058011',id=7,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRPOKUNKx5r99nfeKMhpfm/VZ7AykvwNHlx19s63HAGjMBCMer6PwKksiSdO/uCgcrPPCs4Mdvnww76K8FCrlZ8SSpOgbs2r8XIKgBv2t3yYVeYOMw4Yjg1wzdcpPxGXQ==',key_name='tempest-keypair-1164357353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5ab01b4b8ef44a3b303aca035f69503',ramdisk_id='',reservation_id='r-mufx0for',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-12735973',owner_user_name='tempest-TaggedAttachmentsTest-12735973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c4618cd6154fc6a3205d0b42f5a0f4',uuid=7297de80-2674-4d9e-88e7-7a809bcf7381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converting VIF {"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:38:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c4beea2-41b0-4bf4-be54-170aa75d060a,network=Network(5800b5ee-380b-46ff-83a8-ac91596f1efb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4beea2-41') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG os_vif [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:38:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c4beea2-41b0-4bf4-be54-170aa75d060a,network=Network(5800b5ee-380b-46ff-83a8-ac91596f1efb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4beea2-41') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c4beea2-41, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c4beea2-41, col_values=(('external_ids', {'iface-id': '8c4beea2-41b0-4bf4-be54-170aa75d060a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:38:d8', 'vm-uuid': '7297de80-2674-4d9e-88e7-7a809bcf7381'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:50:38 user nova-compute[72409]: INFO os_vif [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:38:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c4beea2-41b0-4bf4-be54-170aa75d060a,network=Network(5800b5ee-380b-46ff-83a8-ac91596f1efb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4beea2-41')
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.211s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] No BDM found with device name hda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:50:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] No VIF found with MAC fa:16:3e:1b:38:d8, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:50:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Using config drive
Aug 09 22:50:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Cannot resize image /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lazy-loading 'migration_context' on Instance uuid 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Ensure instance console log exists: /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:39 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Creating config drive at /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk.config
Aug 09 22:50:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8cn_j_n5 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8cn_j_n5" returned: 0 in 0.067s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG nova.network.neutron [req-ed554268-feef-431a-8b55-24093c1b800d req-fdf13c12-966c-4daa-8a1b-8721feb49259 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Updated VIF entry in instance network info cache for port 8c4beea2-41b0-4bf4-be54-170aa75d060a. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG nova.network.neutron [req-ed554268-feef-431a-8b55-24093c1b800d req-fdf13c12-966c-4daa-8a1b-8721feb49259 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Updating instance_info_cache with network_info: [{"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ed554268-feef-431a-8b55-24093c1b800d req-fdf13c12-966c-4daa-8a1b-8721feb49259 service nova] Releasing lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Successfully created port: 47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG nova.network.neutron [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Successfully updated port: 3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Acquiring lock "refresh_cache-202694e3-a5ae-48b9-bfa4-0eac9f27f5dd" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Acquired lock "refresh_cache-202694e3-a5ae-48b9-bfa4-0eac9f27f5dd" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG nova.network.neutron [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-87dfce91-ecf4-4dae-a806-b9dfc297b3c5 req-a7b8ff9d-78ed-4aa4-880f-922969993c64 service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Received event network-changed-3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-87dfce91-ecf4-4dae-a806-b9dfc297b3c5 req-a7b8ff9d-78ed-4aa4-880f-922969993c64 service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Refreshing instance network info cache due to event network-changed-3ec2ec10-3c80-4262-888a-95dac8c6b172. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87dfce91-ecf4-4dae-a806-b9dfc297b3c5 req-a7b8ff9d-78ed-4aa4-880f-922969993c64 service nova] Acquiring lock "refresh_cache-202694e3-a5ae-48b9-bfa4-0eac9f27f5dd" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:39 user nova-compute[72409]: DEBUG nova.network.neutron [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.network.neutron [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Updating instance_info_cache with network_info: [{"id": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "address": "fa:16:3e:0d:f1:45", "network": {"id": "02696fba-3297-48c9-a6ec-6189eff28116", "bridge": "br-int", "label": "tempest-VolumesActionsTest-930483453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2c901cd7c354ef3995541c399ad6b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec2ec10-3c", "ovs_interfaceid": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Releasing lock "refresh_cache-202694e3-a5ae-48b9-bfa4-0eac9f27f5dd" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Instance network_info: |[{"id": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "address": "fa:16:3e:0d:f1:45", "network": {"id": "02696fba-3297-48c9-a6ec-6189eff28116", "bridge": "br-int", "label": "tempest-VolumesActionsTest-930483453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2c901cd7c354ef3995541c399ad6b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec2ec10-3c", "ovs_interfaceid": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87dfce91-ecf4-4dae-a806-b9dfc297b3c5 req-a7b8ff9d-78ed-4aa4-880f-922969993c64 service nova] Acquired lock "refresh_cache-202694e3-a5ae-48b9-bfa4-0eac9f27f5dd" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.network.neutron [req-87dfce91-ecf4-4dae-a806-b9dfc297b3c5 req-a7b8ff9d-78ed-4aa4-880f-922969993c64 service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Refreshing network info cache for port 3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Start _get_guest_xml network_info=[{"id": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "address": "fa:16:3e:0d:f1:45", "network": {"id": "02696fba-3297-48c9-a6ec-6189eff28116", "bridge": "br-int", "label": "tempest-VolumesActionsTest-930483453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2c901cd7c354ef3995541c399ad6b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec2ec10-3c", "ovs_interfaceid": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:50:40 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:40 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1421648356',display_name='tempest-VolumesActionsTest-instance-1421648356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1421648356',id=8,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2c901cd7c354ef3995541c399ad6b53',ramdisk_id='',reservation_id='r-wr5v70y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-42932609',owner_user_name='tempest-VolumesActionsTest-42932609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:37Z,user_data=None,user_id='e9c4bf079af74145823bf7023dc03e86',uuid=202694e3-a5ae-48b9-bfa4-0eac9f27f5dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "address": "fa:16:3e:0d:f1:45", "network": {"id": "02696fba-3297-48c9-a6ec-6189eff28116", "bridge": "br-int", "label": "tempest-VolumesActionsTest-930483453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2c901cd7c354ef3995541c399ad6b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec2ec10-3c", "ovs_interfaceid": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Converting VIF {"id": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "address": "fa:16:3e:0d:f1:45", "network": {"id": "02696fba-3297-48c9-a6ec-6189eff28116", "bridge": "br-int", "label": "tempest-VolumesActionsTest-930483453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2c901cd7c354ef3995541c399ad6b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec2ec10-3c", "ovs_interfaceid": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:45,bridge_name='br-int',has_traffic_filtering=True,id=3ec2ec10-3c80-4262-888a-95dac8c6b172,network=Network(02696fba-3297-48c9-a6ec-6189eff28116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec2ec10-3c') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.objects.instance [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lazy-loading 'pci_devices' on Instance uuid 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:50:40 user nova-compute[72409]:   <uuid>202694e3-a5ae-48b9-bfa4-0eac9f27f5dd</uuid>
Aug 09 22:50:40 user nova-compute[72409]:   <name>instance-00000008</name>
Aug 09 22:50:40 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:50:40 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:50:40 user nova-compute[72409]:   <metadata>
Aug 09 22:50:40 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:50:40 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:50:40 user nova-compute[72409]:       <nova:name>tempest-VolumesActionsTest-instance-1421648356</nova:name>
Aug 09 22:50:40 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:50:40</nova:creationTime>
Aug 09 22:50:40 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:50:40 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:50:40 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:50:40 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:50:40 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:50:40 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:50:40 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:50:40 user nova-compute[72409]:       <nova:owner>
Aug 09 22:50:40 user nova-compute[72409]:         <nova:user uuid="e9c4bf079af74145823bf7023dc03e86">tempest-VolumesActionsTest-42932609-project-member</nova:user>
Aug 09 22:50:40 user nova-compute[72409]:         <nova:project uuid="e2c901cd7c354ef3995541c399ad6b53">tempest-VolumesActionsTest-42932609</nova:project>
Aug 09 22:50:40 user nova-compute[72409]:       </nova:owner>
Aug 09 22:50:40 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:50:40 user nova-compute[72409]:       <nova:ports>
Aug 09 22:50:40 user nova-compute[72409]:         <nova:port uuid="3ec2ec10-3c80-4262-888a-95dac8c6b172">
Aug 09 22:50:40 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 22:50:40 user nova-compute[72409]:         </nova:port>
Aug 09 22:50:40 user nova-compute[72409]:       </nova:ports>
Aug 09 22:50:40 user nova-compute[72409]:     </nova:instance>
Aug 09 22:50:40 user nova-compute[72409]:   </metadata>
Aug 09 22:50:40 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:50:40 user nova-compute[72409]:     <system>
Aug 09 22:50:40 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:50:40 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:50:40 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:50:40 user nova-compute[72409]:       <entry name="serial">202694e3-a5ae-48b9-bfa4-0eac9f27f5dd</entry>
Aug 09 22:50:40 user nova-compute[72409]:       <entry name="uuid">202694e3-a5ae-48b9-bfa4-0eac9f27f5dd</entry>
Aug 09 22:50:40 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:50:40 user nova-compute[72409]:     </system>
Aug 09 22:50:40 user nova-compute[72409]:   </sysinfo>
Aug 09 22:50:40 user nova-compute[72409]:   <os>
Aug 09 22:50:40 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:50:40 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:50:40 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:50:40 user nova-compute[72409]:   </os>
Aug 09 22:50:40 user nova-compute[72409]:   <features>
Aug 09 22:50:40 user nova-compute[72409]:     <acpi/>
Aug 09 22:50:40 user nova-compute[72409]:     <apic/>
Aug 09 22:50:40 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:50:40 user nova-compute[72409]:   </features>
Aug 09 22:50:40 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:50:40 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:50:40 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:50:40 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:50:40 user nova-compute[72409]:   </clock>
Aug 09 22:50:40 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:50:40 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:50:40 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:50:40 user nova-compute[72409]:   </cpu>
Aug 09 22:50:40 user nova-compute[72409]:   <devices>
Aug 09 22:50:40 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:50:40 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:50:40 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk"/>
Aug 09 22:50:40 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:50:40 user nova-compute[72409]:     </disk>
Aug 09 22:50:40 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:50:40 user nova-compute[72409]:       <mac address="fa:16:3e:0d:f1:45"/>
Aug 09 22:50:40 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:40 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:50:40 user nova-compute[72409]:       <target dev="tap3ec2ec10-3c"/>
Aug 09 22:50:40 user nova-compute[72409]:     </interface>
Aug 09 22:50:40 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:50:40 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/console.log" append="off"/>
Aug 09 22:50:40 user nova-compute[72409]:     </serial>
Aug 09 22:50:40 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:50:40 user nova-compute[72409]:     <video>
Aug 09 22:50:40 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:40 user nova-compute[72409]:     </video>
Aug 09 22:50:40 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:50:40 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:50:40 user nova-compute[72409]:     </rng>
Aug 09 22:50:40 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:50:40 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:50:40 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:50:40 user nova-compute[72409]:     </memballoon>
Aug 09 22:50:40 user nova-compute[72409]:   </devices>
Aug 09 22:50:40 user nova-compute[72409]: </domain>
Aug 09 22:50:40 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1421648356',display_name='tempest-VolumesActionsTest-instance-1421648356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1421648356',id=8,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2c901cd7c354ef3995541c399ad6b53',ramdisk_id='',reservation_id='r-wr5v70y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-42932609',owner_user_name='tempest-VolumesActionsTest-42932609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:37Z,user_data=None,user_id='e9c4bf079af74145823bf7023dc03e86',uuid=202694e3-a5ae-48b9-bfa4-0eac9f27f5dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "address": "fa:16:3e:0d:f1:45", "network": {"id": "02696fba-3297-48c9-a6ec-6189eff28116", "bridge": "br-int", "label": "tempest-VolumesActionsTest-930483453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2c901cd7c354ef3995541c399ad6b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec2ec10-3c", "ovs_interfaceid": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Converting VIF {"id": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "address": "fa:16:3e:0d:f1:45", "network": {"id": "02696fba-3297-48c9-a6ec-6189eff28116", "bridge": "br-int", "label": "tempest-VolumesActionsTest-930483453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2c901cd7c354ef3995541c399ad6b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec2ec10-3c", "ovs_interfaceid": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:45,bridge_name='br-int',has_traffic_filtering=True,id=3ec2ec10-3c80-4262-888a-95dac8c6b172,network=Network(02696fba-3297-48c9-a6ec-6189eff28116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec2ec10-3c') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG os_vif [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:45,bridge_name='br-int',has_traffic_filtering=True,id=3ec2ec10-3c80-4262-888a-95dac8c6b172,network=Network(02696fba-3297-48c9-a6ec-6189eff28116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec2ec10-3c') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ec2ec10-3c, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ec2ec10-3c, col_values=(('external_ids', {'iface-id': '3ec2ec10-3c80-4262-888a-95dac8c6b172', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:f1:45', 'vm-uuid': '202694e3-a5ae-48b9-bfa4-0eac9f27f5dd'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:40 user nova-compute[72409]: INFO os_vif [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:45,bridge_name='br-int',has_traffic_filtering=True,id=3ec2ec10-3c80-4262-888a-95dac8c6b172,network=Network(02696fba-3297-48c9-a6ec-6189eff28116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec2ec10-3c')
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] There are 0 instances to clean {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] No VIF found with MAC fa:16:3e:0d:f1:45, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:50:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-ebd99871-dceb-4103-9f38-d098a6ca65a7 req-89b0823b-d9bc-4738-bca7-3176508d80c4 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-vif-plugged-8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ebd99871-dceb-4103-9f38-d098a6ca65a7 req-89b0823b-d9bc-4738-bca7-3176508d80c4 service nova] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ebd99871-dceb-4103-9f38-d098a6ca65a7 req-89b0823b-d9bc-4738-bca7-3176508d80c4 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ebd99871-dceb-4103-9f38-d098a6ca65a7 req-89b0823b-d9bc-4738-bca7-3176508d80c4 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-ebd99871-dceb-4103-9f38-d098a6ca65a7 req-89b0823b-d9bc-4738-bca7-3176508d80c4 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] No waiting events found dispatching network-vif-plugged-8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:41 user nova-compute[72409]: WARNING nova.compute.manager [req-ebd99871-dceb-4103-9f38-d098a6ca65a7 req-89b0823b-d9bc-4738-bca7-3176508d80c4 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received unexpected event network-vif-plugged-8c4beea2-41b0-4bf4-be54-170aa75d060a for instance with vm_state building and task_state spawning.
Aug 09 22:50:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Successfully updated port: 47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "refresh_cache-2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquired lock "refresh_cache-2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG nova.network.neutron [req-87dfce91-ecf4-4dae-a806-b9dfc297b3c5 req-a7b8ff9d-78ed-4aa4-880f-922969993c64 service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Updated VIF entry in instance network info cache for port 3ec2ec10-3c80-4262-888a-95dac8c6b172. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG nova.network.neutron [req-87dfce91-ecf4-4dae-a806-b9dfc297b3c5 req-a7b8ff9d-78ed-4aa4-880f-922969993c64 service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Updating instance_info_cache with network_info: [{"id": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "address": "fa:16:3e:0d:f1:45", "network": {"id": "02696fba-3297-48c9-a6ec-6189eff28116", "bridge": "br-int", "label": "tempest-VolumesActionsTest-930483453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2c901cd7c354ef3995541c399ad6b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec2ec10-3c", "ovs_interfaceid": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-b2dcdebd-102c-4833-a2d9-6fae72f41026 req-bb1c8341-a46a-46f3-b545-df22b0297ef1 service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received event network-changed-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-b2dcdebd-102c-4833-a2d9-6fae72f41026 req-bb1c8341-a46a-46f3-b545-df22b0297ef1 service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Refreshing instance network info cache due to event network-changed-47a0bdd7-ce8f-475f-a9a0-231959ed4ead. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b2dcdebd-102c-4833-a2d9-6fae72f41026 req-bb1c8341-a46a-46f3-b545-df22b0297ef1 service nova] Acquiring lock "refresh_cache-2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87dfce91-ecf4-4dae-a806-b9dfc297b3c5 req-a7b8ff9d-78ed-4aa4-880f-922969993c64 service nova] Releasing lock "refresh_cache-202694e3-a5ae-48b9-bfa4-0eac9f27f5dd" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Updating instance_info_cache with network_info: [{"id": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "address": "fa:16:3e:d7:57:ed", "network": {"id": "9bc6437a-445d-4bd1-8fd5-56e4d64fc45e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1499918820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bd4aed4e4c43cb9e3096f4f3757776", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a0bdd7-ce", "ovs_interfaceid": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Releasing lock "refresh_cache-2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Instance network_info: |[{"id": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "address": "fa:16:3e:d7:57:ed", "network": {"id": "9bc6437a-445d-4bd1-8fd5-56e4d64fc45e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1499918820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bd4aed4e4c43cb9e3096f4f3757776", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a0bdd7-ce", "ovs_interfaceid": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b2dcdebd-102c-4833-a2d9-6fae72f41026 req-bb1c8341-a46a-46f3-b545-df22b0297ef1 service nova] Acquired lock "refresh_cache-2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.network.neutron [req-b2dcdebd-102c-4833-a2d9-6fae72f41026 req-bb1c8341-a46a-46f3-b545-df22b0297ef1 service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Refreshing network info cache for port 47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Start _get_guest_xml network_info=[{"id": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "address": "fa:16:3e:d7:57:ed", "network": {"id": "9bc6437a-445d-4bd1-8fd5-56e4d64fc45e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1499918820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bd4aed4e4c43cb9e3096f4f3757776", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a0bdd7-ce", "ovs_interfaceid": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:50:42 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:42 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-290822892',display_name='tempest-TestVolumeSwap-server-290822892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-290822892',id=9,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2K9bVIsnCKXRUyaC0PI5l7dBEUYRM+PUmw3ExgQG9Rh4wfPio/CXDC6bTckE3pUr9SPBU6zQBR0+1tAxRFSNLdYWYMKSbS8RVpyfJ0FyY53Pb6vX0GphL8jXa0LrJlgw==',key_name='tempest-keypair-1606677701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9bd4aed4e4c43cb9e3096f4f3757776',ramdisk_id='',reservation_id='r-3khbx4w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-650053428',owner_user_name='tempest-TestVolumeSwap-650053428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4e2dfc7c744b4d8ee4f285cbd6861e',uuid=2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "address": "fa:16:3e:d7:57:ed", "network": {"id": "9bc6437a-445d-4bd1-8fd5-56e4d64fc45e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1499918820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bd4aed4e4c43cb9e3096f4f3757776", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a0bdd7-ce", "ovs_interfaceid": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Converting VIF {"id": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "address": "fa:16:3e:d7:57:ed", "network": {"id": "9bc6437a-445d-4bd1-8fd5-56e4d64fc45e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1499918820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bd4aed4e4c43cb9e3096f4f3757776", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a0bdd7-ce", "ovs_interfaceid": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=47a0bdd7-ce8f-475f-a9a0-231959ed4ead,network=Network(9bc6437a-445d-4bd1-8fd5-56e4d64fc45e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a0bdd7-ce') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:50:42 user nova-compute[72409]:   <uuid>2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b</uuid>
Aug 09 22:50:42 user nova-compute[72409]:   <name>instance-00000009</name>
Aug 09 22:50:42 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:50:42 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:50:42 user nova-compute[72409]:   <metadata>
Aug 09 22:50:42 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:50:42 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:50:42 user nova-compute[72409]:       <nova:name>tempest-TestVolumeSwap-server-290822892</nova:name>
Aug 09 22:50:42 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:50:42</nova:creationTime>
Aug 09 22:50:42 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:50:42 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:50:42 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:50:42 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:50:42 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:50:42 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:50:42 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:50:42 user nova-compute[72409]:       <nova:owner>
Aug 09 22:50:42 user nova-compute[72409]:         <nova:user uuid="df4e2dfc7c744b4d8ee4f285cbd6861e">tempest-TestVolumeSwap-650053428-project-member</nova:user>
Aug 09 22:50:42 user nova-compute[72409]:         <nova:project uuid="f9bd4aed4e4c43cb9e3096f4f3757776">tempest-TestVolumeSwap-650053428</nova:project>
Aug 09 22:50:42 user nova-compute[72409]:       </nova:owner>
Aug 09 22:50:42 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:50:42 user nova-compute[72409]:       <nova:ports>
Aug 09 22:50:42 user nova-compute[72409]:         <nova:port uuid="47a0bdd7-ce8f-475f-a9a0-231959ed4ead">
Aug 09 22:50:42 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 22:50:42 user nova-compute[72409]:         </nova:port>
Aug 09 22:50:42 user nova-compute[72409]:       </nova:ports>
Aug 09 22:50:42 user nova-compute[72409]:     </nova:instance>
Aug 09 22:50:42 user nova-compute[72409]:   </metadata>
Aug 09 22:50:42 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:50:42 user nova-compute[72409]:     <system>
Aug 09 22:50:42 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:50:42 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:50:42 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:50:42 user nova-compute[72409]:       <entry name="serial">2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b</entry>
Aug 09 22:50:42 user nova-compute[72409]:       <entry name="uuid">2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b</entry>
Aug 09 22:50:42 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:50:42 user nova-compute[72409]:     </system>
Aug 09 22:50:42 user nova-compute[72409]:   </sysinfo>
Aug 09 22:50:42 user nova-compute[72409]:   <os>
Aug 09 22:50:42 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:50:42 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:50:42 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:50:42 user nova-compute[72409]:   </os>
Aug 09 22:50:42 user nova-compute[72409]:   <features>
Aug 09 22:50:42 user nova-compute[72409]:     <acpi/>
Aug 09 22:50:42 user nova-compute[72409]:     <apic/>
Aug 09 22:50:42 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:50:42 user nova-compute[72409]:   </features>
Aug 09 22:50:42 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:50:42 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:50:42 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:50:42 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:50:42 user nova-compute[72409]:   </clock>
Aug 09 22:50:42 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:50:42 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:50:42 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:50:42 user nova-compute[72409]:   </cpu>
Aug 09 22:50:42 user nova-compute[72409]:   <devices>
Aug 09 22:50:42 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:50:42 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:50:42 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk"/>
Aug 09 22:50:42 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:50:42 user nova-compute[72409]:     </disk>
Aug 09 22:50:42 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:50:42 user nova-compute[72409]:       <mac address="fa:16:3e:d7:57:ed"/>
Aug 09 22:50:42 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:42 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:50:42 user nova-compute[72409]:       <target dev="tap47a0bdd7-ce"/>
Aug 09 22:50:42 user nova-compute[72409]:     </interface>
Aug 09 22:50:42 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:50:42 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/console.log" append="off"/>
Aug 09 22:50:42 user nova-compute[72409]:     </serial>
Aug 09 22:50:42 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:50:42 user nova-compute[72409]:     <video>
Aug 09 22:50:42 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:50:42 user nova-compute[72409]:     </video>
Aug 09 22:50:42 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:50:42 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:50:42 user nova-compute[72409]:     </rng>
Aug 09 22:50:42 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:50:42 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:50:42 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:50:42 user nova-compute[72409]:     </memballoon>
Aug 09 22:50:42 user nova-compute[72409]:   </devices>
Aug 09 22:50:42 user nova-compute[72409]: </domain>
Aug 09 22:50:42 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-290822892',display_name='tempest-TestVolumeSwap-server-290822892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-290822892',id=9,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2K9bVIsnCKXRUyaC0PI5l7dBEUYRM+PUmw3ExgQG9Rh4wfPio/CXDC6bTckE3pUr9SPBU6zQBR0+1tAxRFSNLdYWYMKSbS8RVpyfJ0FyY53Pb6vX0GphL8jXa0LrJlgw==',key_name='tempest-keypair-1606677701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9bd4aed4e4c43cb9e3096f4f3757776',ramdisk_id='',reservation_id='r-3khbx4w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-650053428',owner_user_name='tempest-TestVolumeSwap-650053428-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4e2dfc7c744b4d8ee4f285cbd6861e',uuid=2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "address": "fa:16:3e:d7:57:ed", "network": {"id": "9bc6437a-445d-4bd1-8fd5-56e4d64fc45e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1499918820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bd4aed4e4c43cb9e3096f4f3757776", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a0bdd7-ce", "ovs_interfaceid": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Converting VIF {"id": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "address": "fa:16:3e:d7:57:ed", "network": {"id": "9bc6437a-445d-4bd1-8fd5-56e4d64fc45e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1499918820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bd4aed4e4c43cb9e3096f4f3757776", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a0bdd7-ce", "ovs_interfaceid": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=47a0bdd7-ce8f-475f-a9a0-231959ed4ead,network=Network(9bc6437a-445d-4bd1-8fd5-56e4d64fc45e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a0bdd7-ce') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG os_vif [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=47a0bdd7-ce8f-475f-a9a0-231959ed4ead,network=Network(9bc6437a-445d-4bd1-8fd5-56e4d64fc45e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a0bdd7-ce') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47a0bdd7-ce, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47a0bdd7-ce, col_values=(('external_ids', {'iface-id': '47a0bdd7-ce8f-475f-a9a0-231959ed4ead', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:57:ed', 'vm-uuid': '2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:42 user nova-compute[72409]: INFO os_vif [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=47a0bdd7-ce8f-475f-a9a0-231959ed4ead,network=Network(9bc6437a-445d-4bd1-8fd5-56e4d64fc45e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a0bdd7-ce')
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] No VIF found with MAC fa:16:3e:d7:57:ed, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:50:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG nova.network.neutron [req-b2dcdebd-102c-4833-a2d9-6fae72f41026 req-bb1c8341-a46a-46f3-b545-df22b0297ef1 service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Updated VIF entry in instance network info cache for port 47a0bdd7-ce8f-475f-a9a0-231959ed4ead. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG nova.network.neutron [req-b2dcdebd-102c-4833-a2d9-6fae72f41026 req-bb1c8341-a46a-46f3-b545-df22b0297ef1 service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Updating instance_info_cache with network_info: [{"id": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "address": "fa:16:3e:d7:57:ed", "network": {"id": "9bc6437a-445d-4bd1-8fd5-56e4d64fc45e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1499918820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bd4aed4e4c43cb9e3096f4f3757776", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a0bdd7-ce", "ovs_interfaceid": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b2dcdebd-102c-4833-a2d9-6fae72f41026 req-bb1c8341-a46a-46f3-b545-df22b0297ef1 service nova] Releasing lock "refresh_cache-2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-4e4868e7-dc3e-4a61-851b-c2027e0d6680 req-f4b8c7da-c9db-49b2-970c-ea36b527d28e service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-vif-plugged-8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4e4868e7-dc3e-4a61-851b-c2027e0d6680 req-f4b8c7da-c9db-49b2-970c-ea36b527d28e service nova] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4e4868e7-dc3e-4a61-851b-c2027e0d6680 req-f4b8c7da-c9db-49b2-970c-ea36b527d28e service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4e4868e7-dc3e-4a61-851b-c2027e0d6680 req-f4b8c7da-c9db-49b2-970c-ea36b527d28e service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-4e4868e7-dc3e-4a61-851b-c2027e0d6680 req-f4b8c7da-c9db-49b2-970c-ea36b527d28e service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] No waiting events found dispatching network-vif-plugged-8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:43 user nova-compute[72409]: WARNING nova.compute.manager [req-4e4868e7-dc3e-4a61-851b-c2027e0d6680 req-f4b8c7da-c9db-49b2-970c-ea36b527d28e service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received unexpected event network-vif-plugged-8c4beea2-41b0-4bf4-be54-170aa75d060a for instance with vm_state building and task_state spawning.
Aug 09 22:50:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-f0afe0c4-f473-4077-b448-1c18821d47d0 req-0edfc58e-29f6-425c-88eb-9eae8aa270ad service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Received event network-vif-plugged-3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f0afe0c4-f473-4077-b448-1c18821d47d0 req-0edfc58e-29f6-425c-88eb-9eae8aa270ad service nova] Acquiring lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f0afe0c4-f473-4077-b448-1c18821d47d0 req-0edfc58e-29f6-425c-88eb-9eae8aa270ad service nova] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f0afe0c4-f473-4077-b448-1c18821d47d0 req-0edfc58e-29f6-425c-88eb-9eae8aa270ad service nova] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-f0afe0c4-f473-4077-b448-1c18821d47d0 req-0edfc58e-29f6-425c-88eb-9eae8aa270ad service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] No waiting events found dispatching network-vif-plugged-3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:43 user nova-compute[72409]: WARNING nova.compute.manager [req-f0afe0c4-f473-4077-b448-1c18821d47d0 req-0edfc58e-29f6-425c-88eb-9eae8aa270ad service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Received unexpected event network-vif-plugged-3ec2ec10-3c80-4262-888a-95dac8c6b172 for instance with vm_state building and task_state spawning.
Aug 09 22:50:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:43 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:50:44 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:50:44 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:50:44 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:50:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:44 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:50:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-e8b15a32-16ba-4d6e-bc33-c874bf30875b req-a7d09f52-41d0-4b95-8558-5ea47b9ab2ca service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received event network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e8b15a32-16ba-4d6e-bc33-c874bf30875b req-a7d09f52-41d0-4b95-8558-5ea47b9ab2ca service nova] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e8b15a32-16ba-4d6e-bc33-c874bf30875b req-a7d09f52-41d0-4b95-8558-5ea47b9ab2ca service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e8b15a32-16ba-4d6e-bc33-c874bf30875b req-a7d09f52-41d0-4b95-8558-5ea47b9ab2ca service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-e8b15a32-16ba-4d6e-bc33-c874bf30875b req-a7d09f52-41d0-4b95-8558-5ea47b9ab2ca service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] No waiting events found dispatching network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:45 user nova-compute[72409]: WARNING nova.compute.manager [req-e8b15a32-16ba-4d6e-bc33-c874bf30875b req-a7d09f52-41d0-4b95-8558-5ea47b9ab2ca service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received unexpected event network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead for instance with vm_state building and task_state spawning.
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-65081426-fcec-44fe-9e3e-2e04a1be121a req-05a3b258-96d8-4500-b8a6-78b05cef7208 service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Received event network-vif-plugged-3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-65081426-fcec-44fe-9e3e-2e04a1be121a req-05a3b258-96d8-4500-b8a6-78b05cef7208 service nova] Acquiring lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-65081426-fcec-44fe-9e3e-2e04a1be121a req-05a3b258-96d8-4500-b8a6-78b05cef7208 service nova] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-65081426-fcec-44fe-9e3e-2e04a1be121a req-05a3b258-96d8-4500-b8a6-78b05cef7208 service nova] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-65081426-fcec-44fe-9e3e-2e04a1be121a req-05a3b258-96d8-4500-b8a6-78b05cef7208 service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] No waiting events found dispatching network-vif-plugged-3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:45 user nova-compute[72409]: WARNING nova.compute.manager [req-65081426-fcec-44fe-9e3e-2e04a1be121a req-05a3b258-96d8-4500-b8a6-78b05cef7208 service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Received unexpected event network-vif-plugged-3ec2ec10-3c80-4262-888a-95dac8c6b172 for instance with vm_state building and task_state spawning.
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621445.70139, 7297de80-2674-4d9e-88e7-7a809bcf7381 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:45 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] VM Resumed (Lifecycle Event)
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Instance spawned successfully.
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:45 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621445.7193732, 7297de80-2674-4d9e-88e7-7a809bcf7381 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:45 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] VM Started (Lifecycle Event)
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:45 user nova-compute[72409]: INFO nova.compute.manager [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Took 10.53 seconds to spawn the instance on the hypervisor.
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:46 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:46 user nova-compute[72409]: INFO nova.compute.manager [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Took 11.83 seconds to build instance.
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7854a104-71a1-47c1-809a-b3e795c17101 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.972s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621447.1948247, 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:47 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] VM Resumed (Lifecycle Event)
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:47 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Instance spawned successfully.
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:47 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621447.1956494, 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:47 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] VM Started (Lifecycle Event)
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.compute.manager [req-98827b6e-aa81-4ffe-9769-aaa468c89571 req-daaf62df-b298-4949-a02e-3d576c03773a service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received event network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-98827b6e-aa81-4ffe-9769-aaa468c89571 req-daaf62df-b298-4949-a02e-3d576c03773a service nova] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-98827b6e-aa81-4ffe-9769-aaa468c89571 req-daaf62df-b298-4949-a02e-3d576c03773a service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-98827b6e-aa81-4ffe-9769-aaa468c89571 req-daaf62df-b298-4949-a02e-3d576c03773a service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.compute.manager [req-98827b6e-aa81-4ffe-9769-aaa468c89571 req-daaf62df-b298-4949-a02e-3d576c03773a service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] No waiting events found dispatching network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:50:47 user nova-compute[72409]: WARNING nova.compute.manager [req-98827b6e-aa81-4ffe-9769-aaa468c89571 req-daaf62df-b298-4949-a02e-3d576c03773a service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received unexpected event network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead for instance with vm_state building and task_state spawning.
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:47 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:47 user nova-compute[72409]: INFO nova.compute.manager [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Took 10.46 seconds to spawn the instance on the hypervisor.
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:47 user nova-compute[72409]: INFO nova.compute.manager [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Took 11.83 seconds to build instance.
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621447.8026826, 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:47 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] VM Resumed (Lifecycle Event)
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:50:47 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Instance spawned successfully.
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-969a8bdc-46eb-42bc-b590-3baade0a69ba tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.145s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:47 user nova-compute[72409]: INFO nova.compute.manager [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Took 9.74 seconds to spawn the instance on the hypervisor.
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:47 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:47 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621447.8083344, 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:50:47 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] VM Started (Lifecycle Event)
Aug 09 22:50:48 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:50:48 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:50:48 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:50:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:48 user nova-compute[72409]: INFO nova.compute.manager [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Took 11.98 seconds to build instance.
Aug 09 22:50:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a9141acc-fc2b-4b9f-923e-e566b302885e tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.208s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:50 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:50 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:50:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7755MB free_disk=25.885074615478516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:50:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:50:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 9fce283c-f8da-4dd8-89be-64eba9d8486c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:50:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:50:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5af7f4c7-5937-4b69-831e-941d7de4417d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:50:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7b252875-ae91-4f8c-ae44-71097f9809a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7297de80-2674-4d9e-88e7-7a809bcf7381 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 29a04807-1c46-4546-b78c-73d4f2b86c46 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing inventories for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating ProviderTree inventory for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing aggregate associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, aggregates: None {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing trait associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.458s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.558s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:50:51 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:50:51 user nova-compute[72409]: INFO nova.compute.claims [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Claim successful on node user
Aug 09 22:50:52 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:50:52 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:50:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:50:52 user nova-compute[72409]: INFO nova.virt.block_device [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Booting with volume 531786d5-d1a0-48d4-9074-1d5dd0797145 at /dev/vda
Aug 09 22:50:52 user nova-compute[72409]: DEBUG nova.policy [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0be4e91cf0054f548ea7a1d75426b72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501f4894d8ce46d08a02baf924d7e51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG os_brick.utils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:50:52 user nova-compute[72409]: INFO oslo.privsep.daemon [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpsepog_0t/privsep.sock']
Aug 09 22:50:52 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Skipping network cache update for instance because it is Building. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 22:50:52 user sudo[83193]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpsepog_0t/privsep.sock
Aug 09 22:50:52 user sudo[83193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 22:50:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 22:50:52 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 935c4677-a511-4b0e-aef3-57bc036220ab {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:50:53 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Updating instance_info_cache with network_info: [{"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 22:50:53 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:50:53 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:50:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:50:53 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Successfully created port: c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:50:54 user sudo[83193]: pam_unix(sudo:session): session closed for user root
Aug 09 22:50:54 user nova-compute[72409]: INFO oslo.privsep.daemon [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Spawned new privsep daemon via rootwrap
Aug 09 22:50:54 user nova-compute[72409]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 22:50:54 user nova-compute[72409]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 22:50:54 user nova-compute[72409]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 09 22:50:54 user nova-compute[72409]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83250
Aug 09 22:50:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[910c08a9-09ca-49f1-9d4d-a6ba94105471]: (2,) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Successfully updated port: c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "refresh_cache-29a04807-1c46-4546-b78c-73d4f2b86c46" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquired lock "refresh_cache-29a04807-1c46-4546-b78c-73d4f2b86c46" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-d331a016-c475-4263-9146-762b798036c1 req-e841ddfa-c825-402c-b840-6e758e5fb870 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event network-changed-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-d331a016-c475-4263-9146-762b798036c1 req-e841ddfa-c825-402c-b840-6e758e5fb870 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Refreshing instance network info cache due to event network-changed-c37915d3-63af-47d7-8618-adee0e79e4ce. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d331a016-c475-4263-9146-762b798036c1 req-e841ddfa-c825-402c-b840-6e758e5fb870 service nova] Acquiring lock "refresh_cache-29a04807-1c46-4546-b78c-73d4f2b86c46" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[243502b6-5269-4a18-a721-9931140e278a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:50:55 user nova-compute[72409]: WARNING os_brick.initiator.connectors.nvmeof [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2b38fa-7802-4be3-b053-d1071bec960e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb624bb-35c2-4b76-9e41-aca30ea2df43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45df9a8-3621-4a2c-b6fd-fe9f7d737cd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:50:55 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[04617ab6-034e-4c70-b76a-0a43ea0ab2ad]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG os_brick.utils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] <== get_connector_properties: return (2686ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Updating existing volume attachment record: fca3a19c-82be-49fe-9cdb-9aeffb79bc5f {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Updating instance_info_cache with network_info: [{"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Releasing lock "refresh_cache-29a04807-1c46-4546-b78c-73d4f2b86c46" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Instance network_info: |[{"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d331a016-c475-4263-9146-762b798036c1 req-e841ddfa-c825-402c-b840-6e758e5fb870 service nova] Acquired lock "refresh_cache-29a04807-1c46-4546-b78c-73d4f2b86c46" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG nova.network.neutron [req-d331a016-c475-4263-9146-762b798036c1 req-e841ddfa-c825-402c-b840-6e758e5fb870 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Refreshing network info cache for port c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:50:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:50:56 user nova-compute[72409]: DEBUG nova.network.neutron [req-d331a016-c475-4263-9146-762b798036c1 req-e841ddfa-c825-402c-b840-6e758e5fb870 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Updated VIF entry in instance network info cache for port c37915d3-63af-47d7-8618-adee0e79e4ce. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:50:56 user nova-compute[72409]: DEBUG nova.network.neutron [req-d331a016-c475-4263-9146-762b798036c1 req-e841ddfa-c825-402c-b840-6e758e5fb870 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Updating instance_info_cache with network_info: [{"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:50:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d331a016-c475-4263-9146-762b798036c1 req-e841ddfa-c825-402c-b840-6e758e5fb870 service nova] Releasing lock "refresh_cache-29a04807-1c46-4546-b78c-73d4f2b86c46" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:50:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:51:04 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Creating image(s)
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Ensure instance console log exists: /opt/stack/data/nova/instances/29a04807-1c46-4546-b78c-73d4f2b86c46/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Start _get_guest_xml network_info=[{"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSJapLlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '29a04807-1c46-4546-b78c-73d4f2b86c46', 'attached_at': '', 'detached_at': '', 'volume_id': '531786d5-d1a0-48d4-9074-1d5dd0797145', 'serial': '531786d5-d1a0-48d4-9074-1d5dd0797145'}, 'mount_device': '/dev/vda', 'attachment_id': 'fca3a19c-82be-49fe-9cdb-9aeffb79bc5f', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:51:04 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:51:04 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG os_brick.initiator.connector [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Factory for ISCSI on None {{(pid=72409) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:51:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSJapLlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:51:05 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.009s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:51:05 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:51:05 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28a1e28-1723-40c7-814f-bd7d217adf40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:51:05 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb6b9d1-1012-408d-8551-c4f7c9b51fe7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145] added
Aug 09 22:51:05 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e546ee5-0763-4d28-bc52-2023db07408b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef97c250-71c3-4591-991c-888b5e9c0a9e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSJapLlB {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSJapLlB" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c824751-ee7b-49fb-bfe5-2ca596851dc3]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bSJapLlB'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[244d07da-4f13-470a-8660-88de64b8a745]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[183f207a-0a86-439a-a236-c2461ed46973]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 22:51:05 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 22:51:05 user nova-compute[72409]:  {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:51:05 user nova-compute[72409]: WARNING os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 22:51:05 user nova-compute[72409]: 
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[958dc568-e96a-4b47-a1c4-a5ae1dff7abe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260]
Aug 09 22:51:05 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260] successful.
Aug 09 22:51:05 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75fc7a3-8919-477e-9da8-df1ad19e7055]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c991c3dd-1fbd-4313-81d3-cb0319da3ad9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:05 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:05 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.044s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae86a992-1b0e-46e7-8b90-3aca909b992c]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSJapLlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:51:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26234666139663766', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234666139663766', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1227232666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1227232666',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAoSaQCdVvuh57WXjFA13EBow7aKBmqRgJwb6HwSpyFB+eussplICF19CzXtR/xzCNYd09zaCo7OZWi2arzQlCx/TWpdlW31VSARWFAbCK5rWCe0CK613+EMVVBpM3mvg==',key_name='tempest-keypair-1505891920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='501f4894d8ce46d08a02baf924d7e51e',ramdisk_id='',reservation_id='r-6hu0v00n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1870090794',owner_user_name='tempest-ServerActionsV293TestJSON-1870090794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be4e91cf0054f548ea7a1d75426b72b',uuid=29a04807-1c46-4546-b78c-73d4f2b86c46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Converting VIF {"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG nova.objects.instance [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lazy-loading 'pci_devices' on Instance uuid 29a04807-1c46-4546-b78c-73d4f2b86c46 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:51:06 user nova-compute[72409]:   <uuid>29a04807-1c46-4546-b78c-73d4f2b86c46</uuid>
Aug 09 22:51:06 user nova-compute[72409]:   <name>instance-0000000a</name>
Aug 09 22:51:06 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:51:06 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:51:06 user nova-compute[72409]:   <metadata>
Aug 09 22:51:06 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:51:06 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:51:06 user nova-compute[72409]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1227232666</nova:name>
Aug 09 22:51:06 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:51:04</nova:creationTime>
Aug 09 22:51:06 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:51:06 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:51:06 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:51:06 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:51:06 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:51:06 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:51:06 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:51:06 user nova-compute[72409]:       <nova:owner>
Aug 09 22:51:06 user nova-compute[72409]:         <nova:user uuid="0be4e91cf0054f548ea7a1d75426b72b">tempest-ServerActionsV293TestJSON-1870090794-project-member</nova:user>
Aug 09 22:51:06 user nova-compute[72409]:         <nova:project uuid="501f4894d8ce46d08a02baf924d7e51e">tempest-ServerActionsV293TestJSON-1870090794</nova:project>
Aug 09 22:51:06 user nova-compute[72409]:       </nova:owner>
Aug 09 22:51:06 user nova-compute[72409]:       <nova:ports>
Aug 09 22:51:06 user nova-compute[72409]:         <nova:port uuid="c37915d3-63af-47d7-8618-adee0e79e4ce">
Aug 09 22:51:06 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 22:51:06 user nova-compute[72409]:         </nova:port>
Aug 09 22:51:06 user nova-compute[72409]:       </nova:ports>
Aug 09 22:51:06 user nova-compute[72409]:     </nova:instance>
Aug 09 22:51:06 user nova-compute[72409]:   </metadata>
Aug 09 22:51:06 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:51:06 user nova-compute[72409]:     <system>
Aug 09 22:51:06 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:51:06 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:51:06 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:51:06 user nova-compute[72409]:       <entry name="serial">29a04807-1c46-4546-b78c-73d4f2b86c46</entry>
Aug 09 22:51:06 user nova-compute[72409]:       <entry name="uuid">29a04807-1c46-4546-b78c-73d4f2b86c46</entry>
Aug 09 22:51:06 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:51:06 user nova-compute[72409]:     </system>
Aug 09 22:51:06 user nova-compute[72409]:   </sysinfo>
Aug 09 22:51:06 user nova-compute[72409]:   <os>
Aug 09 22:51:06 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:51:06 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:51:06 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:51:06 user nova-compute[72409]:   </os>
Aug 09 22:51:06 user nova-compute[72409]:   <features>
Aug 09 22:51:06 user nova-compute[72409]:     <acpi/>
Aug 09 22:51:06 user nova-compute[72409]:     <apic/>
Aug 09 22:51:06 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:51:06 user nova-compute[72409]:   </features>
Aug 09 22:51:06 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:51:06 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:51:06 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:51:06 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:51:06 user nova-compute[72409]:   </clock>
Aug 09 22:51:06 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:51:06 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:51:06 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:51:06 user nova-compute[72409]:   </cpu>
Aug 09 22:51:06 user nova-compute[72409]:   <devices>
Aug 09 22:51:06 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:51:06 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:51:06 user nova-compute[72409]:       <source dev="/dev/sdb"/>
Aug 09 22:51:06 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:51:06 user nova-compute[72409]:       <serial>531786d5-d1a0-48d4-9074-1d5dd0797145</serial>
Aug 09 22:51:06 user nova-compute[72409]:     </disk>
Aug 09 22:51:06 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:51:06 user nova-compute[72409]:       <mac address="fa:16:3e:e3:4b:f8"/>
Aug 09 22:51:06 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:51:06 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:51:06 user nova-compute[72409]:       <target dev="tapc37915d3-63"/>
Aug 09 22:51:06 user nova-compute[72409]:     </interface>
Aug 09 22:51:06 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:51:06 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/29a04807-1c46-4546-b78c-73d4f2b86c46/console.log" append="off"/>
Aug 09 22:51:06 user nova-compute[72409]:     </serial>
Aug 09 22:51:06 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:51:06 user nova-compute[72409]:     <video>
Aug 09 22:51:06 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:51:06 user nova-compute[72409]:     </video>
Aug 09 22:51:06 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:51:06 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:51:06 user nova-compute[72409]:     </rng>
Aug 09 22:51:06 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:51:06 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:51:06 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:51:06 user nova-compute[72409]:     </memballoon>
Aug 09 22:51:06 user nova-compute[72409]:   </devices>
Aug 09 22:51:06 user nova-compute[72409]: </domain>
Aug 09 22:51:06 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1227232666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1227232666',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAoSaQCdVvuh57WXjFA13EBow7aKBmqRgJwb6HwSpyFB+eussplICF19CzXtR/xzCNYd09zaCo7OZWi2arzQlCx/TWpdlW31VSARWFAbCK5rWCe0CK613+EMVVBpM3mvg==',key_name='tempest-keypair-1505891920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='501f4894d8ce46d08a02baf924d7e51e',ramdisk_id='',reservation_id='r-6hu0v00n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1870090794',owner_user_name='tempest-ServerActionsV293TestJSON-1870090794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:50:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be4e91cf0054f548ea7a1d75426b72b',uuid=29a04807-1c46-4546-b78c-73d4f2b86c46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Converting VIF {"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG os_vif [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc37915d3-63, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc37915d3-63, col_values=(('external_ids', {'iface-id': 'c37915d3-63af-47d7-8618-adee0e79e4ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:4b:f8', 'vm-uuid': '29a04807-1c46-4546-b78c-73d4f2b86c46'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:06 user nova-compute[72409]: INFO os_vif [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63')
Aug 09 22:51:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:51:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] No VIF found with MAC fa:16:3e:e3:4b:f8, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:51:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:08 user nova-compute[72409]: DEBUG nova.compute.manager [req-c25ce7be-0d6d-4f84-acb7-f78d6aeb1c21 req-20914d94-b775-4f05-bd42-47ed4a50adad service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c25ce7be-0d6d-4f84-acb7-f78d6aeb1c21 req-20914d94-b775-4f05-bd42-47ed4a50adad service nova] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c25ce7be-0d6d-4f84-acb7-f78d6aeb1c21 req-20914d94-b775-4f05-bd42-47ed4a50adad service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c25ce7be-0d6d-4f84-acb7-f78d6aeb1c21 req-20914d94-b775-4f05-bd42-47ed4a50adad service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:08 user nova-compute[72409]: DEBUG nova.compute.manager [req-c25ce7be-0d6d-4f84-acb7-f78d6aeb1c21 req-20914d94-b775-4f05-bd42-47ed4a50adad service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] No waiting events found dispatching network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:51:08 user nova-compute[72409]: WARNING nova.compute.manager [req-c25ce7be-0d6d-4f84-acb7-f78d6aeb1c21 req-20914d94-b775-4f05-bd42-47ed4a50adad service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received unexpected event network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce for instance with vm_state building and task_state spawning.
Aug 09 22:51:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-c1e1410e-dfb1-4261-9f9b-c5c522d556b8 req-ed5ec486-dacc-4e51-bd50-dcbe17315044 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c1e1410e-dfb1-4261-9f9b-c5c522d556b8 req-ed5ec486-dacc-4e51-bd50-dcbe17315044 service nova] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c1e1410e-dfb1-4261-9f9b-c5c522d556b8 req-ed5ec486-dacc-4e51-bd50-dcbe17315044 service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c1e1410e-dfb1-4261-9f9b-c5c522d556b8 req-ed5ec486-dacc-4e51-bd50-dcbe17315044 service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-c1e1410e-dfb1-4261-9f9b-c5c522d556b8 req-ed5ec486-dacc-4e51-bd50-dcbe17315044 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] No waiting events found dispatching network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:51:10 user nova-compute[72409]: WARNING nova.compute.manager [req-c1e1410e-dfb1-4261-9f9b-c5c522d556b8 req-ed5ec486-dacc-4e51-bd50-dcbe17315044 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received unexpected event network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce for instance with vm_state building and task_state spawning.
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621470.4832025, 29a04807-1c46-4546-b78c-73d4f2b86c46 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:51:10 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] VM Resumed (Lifecycle Event)
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:51:10 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Instance spawned successfully.
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:51:10 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621470.4839244, 29a04807-1c46-4546-b78c-73d4f2b86c46 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:51:10 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] VM Started (Lifecycle Event)
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:51:10 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:51:10 user nova-compute[72409]: INFO nova.compute.manager [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 09 22:51:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:51:10 user nova-compute[72409]: INFO nova.compute.manager [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Took 19.62 seconds to build instance.
Aug 09 22:51:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0f5999c3-c1ff-41fa-b5db-a0f1f709b792 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.755s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:51:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:18 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:51:18 user nova-compute[72409]: INFO nova.compute.claims [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Claim successful on node user
Aug 09 22:51:19 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:51:19 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:51:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:51:19 user nova-compute[72409]: INFO nova.virt.block_device [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Booting with volume 40114deb-0fc7-4ddb-92a4-098bbae1c44b at /dev/vda
Aug 09 22:51:19 user nova-compute[72409]: DEBUG os_brick.utils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5ed1d7-b937-4396-b997-6a17cce7c22e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG nova.policy [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '171e03db44fd471cb22befd584e5b8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102ecfc42f6141e79caca70bf05fb91c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d90c656-94a4-4bad-b455-430fa4e699b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1841cff0-3627-4ca2-a068-fd9e8c08440c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9e34ed-a014-4261-a475-edb17c694676]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:51:19 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:51:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce58a37-838b-44cc-9631-294c2a1fb622]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG os_brick.utils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:51:19 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating existing volume attachment record: 00bf71e4-246a-4457-811b-d39417cf81cf {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:51:20 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Successfully created port: 98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:51:20 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Successfully created port: 2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:51:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:21 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Successfully created port: 3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:51:22 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Successfully created port: 755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:51:22 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Successfully created port: c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:51:23 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Successfully updated port: 98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:51:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-7f1e4cf2-b5bb-4896-ae40-6591b9609242 req-ebdd31e7-5cb0-4827-b836-e19dae0dc2a8 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-changed-98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-7f1e4cf2-b5bb-4896-ae40-6591b9609242 req-ebdd31e7-5cb0-4827-b836-e19dae0dc2a8 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing instance network info cache due to event network-changed-98877804-c6b5-45ed-b69b-c502a0936e00. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:51:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7f1e4cf2-b5bb-4896-ae40-6591b9609242 req-ebdd31e7-5cb0-4827-b836-e19dae0dc2a8 service nova] Acquiring lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:51:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7f1e4cf2-b5bb-4896-ae40-6591b9609242 req-ebdd31e7-5cb0-4827-b836-e19dae0dc2a8 service nova] Acquired lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:51:23 user nova-compute[72409]: DEBUG nova.network.neutron [req-7f1e4cf2-b5bb-4896-ae40-6591b9609242 req-ebdd31e7-5cb0-4827-b836-e19dae0dc2a8 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing network info cache for port 98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:51:23 user nova-compute[72409]: DEBUG nova.network.neutron [req-7f1e4cf2-b5bb-4896-ae40-6591b9609242 req-ebdd31e7-5cb0-4827-b836-e19dae0dc2a8 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:51:24 user nova-compute[72409]: DEBUG nova.network.neutron [req-7f1e4cf2-b5bb-4896-ae40-6591b9609242 req-ebdd31e7-5cb0-4827-b836-e19dae0dc2a8 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:51:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7f1e4cf2-b5bb-4896-ae40-6591b9609242 req-ebdd31e7-5cb0-4827-b836-e19dae0dc2a8 service nova] Releasing lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:51:24 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Successfully updated port: 444f3835-540e-46ee-beb4-584610fa1054 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:51:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-7eff286c-34bf-4e85-bbaa-cca9807c09d2 req-cea08d0c-762a-4767-b820-e278be8ef41a service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-changed-444f3835-540e-46ee-beb4-584610fa1054 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-7eff286c-34bf-4e85-bbaa-cca9807c09d2 req-cea08d0c-762a-4767-b820-e278be8ef41a service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing instance network info cache due to event network-changed-444f3835-540e-46ee-beb4-584610fa1054. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:51:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7eff286c-34bf-4e85-bbaa-cca9807c09d2 req-cea08d0c-762a-4767-b820-e278be8ef41a service nova] Acquiring lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:51:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7eff286c-34bf-4e85-bbaa-cca9807c09d2 req-cea08d0c-762a-4767-b820-e278be8ef41a service nova] Acquired lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:51:25 user nova-compute[72409]: DEBUG nova.network.neutron [req-7eff286c-34bf-4e85-bbaa-cca9807c09d2 req-cea08d0c-762a-4767-b820-e278be8ef41a service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing network info cache for port 444f3835-540e-46ee-beb4-584610fa1054 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:51:25 user nova-compute[72409]: DEBUG nova.network.neutron [req-7eff286c-34bf-4e85-bbaa-cca9807c09d2 req-cea08d0c-762a-4767-b820-e278be8ef41a service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:51:25 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Successfully updated port: 91e288dc-da9b-4aa3-b687-e3d5d3c3a300 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:51:25 user nova-compute[72409]: DEBUG nova.network.neutron [req-7eff286c-34bf-4e85-bbaa-cca9807c09d2 req-cea08d0c-762a-4767-b820-e278be8ef41a service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:51:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7eff286c-34bf-4e85-bbaa-cca9807c09d2 req-cea08d0c-762a-4767-b820-e278be8ef41a service nova] Releasing lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:51:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 22:51:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 22:51:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 22:51:26 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Successfully updated port: 2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:51:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-changed-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing instance network info cache due to event network-changed-91e288dc-da9b-4aa3-b687-e3d5d3c3a300. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:51:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] Acquiring lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:51:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] Acquired lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:51:27 user nova-compute[72409]: DEBUG nova.network.neutron [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing network info cache for port 91e288dc-da9b-4aa3-b687-e3d5d3c3a300 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:51:27 user nova-compute[72409]: DEBUG nova.network.neutron [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:51:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Successfully updated port: 3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:51:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:51:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] Releasing lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:51:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-changed-2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing instance network info cache due to event network-changed-2b031157-67a0-4cb0-960e-17042f18cf38. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:51:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] Acquiring lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:51:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] Acquired lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:51:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing network info cache for port 2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:51:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:51:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:51:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aba0c228-c02f-4a72-97bb-f9268e1eaa60 req-2c5540e0-8608-4827-8358-d322fb98c47b service nova] Releasing lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:51:28 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Successfully updated port: 755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:51:29 user nova-compute[72409]: DEBUG nova.compute.manager [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-changed-3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:29 user nova-compute[72409]: DEBUG nova.compute.manager [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing instance network info cache due to event network-changed-3c682de9-37e0-4a27-8ae6-f24fdd328d65. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:51:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] Acquiring lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:51:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] Acquired lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:51:29 user nova-compute[72409]: DEBUG nova.network.neutron [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing network info cache for port 3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:51:29 user nova-compute[72409]: DEBUG nova.network.neutron [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:51:29 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Successfully updated port: c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:51:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] Releasing lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-changed-755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing instance network info cache due to event network-changed-755a9a96-5271-4a79-b6ef-a2c2d4f843cf. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] Acquiring lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] Acquired lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing network info cache for port 755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-011f4a28-6004-4218-ba7e-07db8693f2f6 req-5c1d62bd-51aa-4728-86f0-1b031d1274a5 service nova] Releasing lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquired lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:51:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-461bdc51-f19e-40af-b548-b780f336e209 req-ef93dafa-6fd3-4479-9912-080c2701a669 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-changed-c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-461bdc51-f19e-40af-b548-b780f336e209 req-ef93dafa-6fd3-4479-9912-080c2701a669 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing instance network info cache due to event network-changed-c1f41052-45b3-4f52-81a2-854a211e59b0. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:51:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-461bdc51-f19e-40af-b548-b780f336e209 req-ef93dafa-6fd3-4479-9912-080c2701a669 service nova] Acquiring lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:51:32 user nova-compute[72409]: INFO nova.virt.block_device [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Booting with volume 66d8e1b3-2d63-42b8-88d8-31039efe58b8 at /dev/vdb
Aug 09 22:51:32 user nova-compute[72409]: DEBUG os_brick.utils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[46446cba-6479-457a-be93-9fc0aeb562d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ddd56e-3642-40cc-98e7-4da73f98295b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f53aab-3148-4919-8298-beb4d621c204]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c329729-a195-4840-aba7-2f59c101af51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:51:32 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08abc10-6e6b-4f48-8525-e86231e6473c]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG os_brick.utils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating existing volume attachment record: f01514a9-ca14-4120-b735-34024f60b204 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating instance_info_cache with network_info: [{"id": "98877804-c6b5-45ed-b69b-c502a0936e00", "address": "fa:16:3e:0e:72:1d", "network": {"id": "4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-190846153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98877804-c6", "ovs_interfaceid": "98877804-c6b5-45ed-b69b-c502a0936e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "444f3835-540e-46ee-beb4-584610fa1054", "address": "fa:16:3e:54:71:95", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444f3835-54", "ovs_interfaceid": "444f3835-540e-46ee-beb4-584610fa1054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "address": "fa:16:3e:ec:64:0c", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e288dc-da", "ovs_interfaceid": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b031157-67a0-4cb0-960e-17042f18cf38", "address": "fa:16:3e:3b:28:a1", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b031157-67", "ovs_interfaceid": "2b031157-67a0-4cb0-960e-17042f18cf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "address": "fa:16:3e:f1:b5:12", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c682de9-37", "ovs_interfaceid": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "address": "fa:16:3e:29:4e:3e", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap755a9a96-52", "ovs_interfaceid": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f41052-45b3-4f52-81a2-854a211e59b0", "address": "fa:16:3e:50:07:25", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f41052-45", "ovs_interfaceid": "c1f41052-45b3-4f52-81a2-854a211e59b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Releasing lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Instance network_info: |[{"id": "98877804-c6b5-45ed-b69b-c502a0936e00", "address": "fa:16:3e:0e:72:1d", "network": {"id": "4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-190846153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98877804-c6", "ovs_interfaceid": "98877804-c6b5-45ed-b69b-c502a0936e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "444f3835-540e-46ee-beb4-584610fa1054", "address": "fa:16:3e:54:71:95", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444f3835-54", "ovs_interfaceid": "444f3835-540e-46ee-beb4-584610fa1054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "address": "fa:16:3e:ec:64:0c", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e288dc-da", "ovs_interfaceid": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b031157-67a0-4cb0-960e-17042f18cf38", "address": "fa:16:3e:3b:28:a1", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b031157-67", "ovs_interfaceid": "2b031157-67a0-4cb0-960e-17042f18cf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "address": "fa:16:3e:f1:b5:12", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c682de9-37", "ovs_interfaceid": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "address": "fa:16:3e:29:4e:3e", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap755a9a96-52", "ovs_interfaceid": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f41052-45b3-4f52-81a2-854a211e59b0", "address": "fa:16:3e:50:07:25", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f41052-45", "ovs_interfaceid": "c1f41052-45b3-4f52-81a2-854a211e59b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-461bdc51-f19e-40af-b548-b780f336e209 req-ef93dafa-6fd3-4479-9912-080c2701a669 service nova] Acquired lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:51:32 user nova-compute[72409]: DEBUG nova.network.neutron [req-461bdc51-f19e-40af-b548-b780f336e209 req-ef93dafa-6fd3-4479-9912-080c2701a669 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing network info cache for port c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:51:33 user nova-compute[72409]: DEBUG nova.network.neutron [req-461bdc51-f19e-40af-b548-b780f336e209 req-ef93dafa-6fd3-4479-9912-080c2701a669 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updated VIF entry in instance network info cache for port c1f41052-45b3-4f52-81a2-854a211e59b0. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:51:33 user nova-compute[72409]: DEBUG nova.network.neutron [req-461bdc51-f19e-40af-b548-b780f336e209 req-ef93dafa-6fd3-4479-9912-080c2701a669 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating instance_info_cache with network_info: [{"id": "98877804-c6b5-45ed-b69b-c502a0936e00", "address": "fa:16:3e:0e:72:1d", "network": {"id": "4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-190846153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98877804-c6", "ovs_interfaceid": "98877804-c6b5-45ed-b69b-c502a0936e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "444f3835-540e-46ee-beb4-584610fa1054", "address": "fa:16:3e:54:71:95", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444f3835-54", "ovs_interfaceid": "444f3835-540e-46ee-beb4-584610fa1054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "address": "fa:16:3e:ec:64:0c", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e288dc-da", "ovs_interfaceid": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b031157-67a0-4cb0-960e-17042f18cf38", "address": "fa:16:3e:3b:28:a1", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b031157-67", "ovs_interfaceid": "2b031157-67a0-4cb0-960e-17042f18cf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "address": "fa:16:3e:f1:b5:12", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c682de9-37", "ovs_interfaceid": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "address": "fa:16:3e:29:4e:3e", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap755a9a96-52", "ovs_interfaceid": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f41052-45b3-4f52-81a2-854a211e59b0", "address": "fa:16:3e:50:07:25", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f41052-45", "ovs_interfaceid": "c1f41052-45b3-4f52-81a2-854a211e59b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:51:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-461bdc51-f19e-40af-b548-b780f336e209 req-ef93dafa-6fd3-4479-9912-080c2701a669 service nova] Releasing lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:51:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:41 user nova-compute[72409]: INFO nova.virt.block_device [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Booting with volume 3971a75c-ba13-46c7-86ac-7992e186ffbf at /dev/vdc
Aug 09 22:51:41 user nova-compute[72409]: DEBUG os_brick.utils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0017b7a5-723c-4686-9ce5-8e91d92ae2d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7945a60a-e476-476c-8d21-8ef1ed248bf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3309d068-a3a2-465a-a1ce-7fe77ca3a6ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6888d70b-3ee3-4592-aded-008e109b49c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:51:41 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:51:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe4b61c-85c4-468b-a317-1c99036d116e]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG os_brick.utils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating existing volume attachment record: ec59bde3-c44a-4fd5-9bf8-cd3a2908be91 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:51:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:43 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:51:43 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:51:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:51:44 user nova-compute[72409]: INFO nova.compute.manager [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] instance snapshotting
Aug 09 22:51:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Beginning live snapshot process
Aug 09 22:51:44 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:51:44 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:51:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json -f qcow2 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json -f qcow2 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.163s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplrheu8a3/27d650ce0e83488f8fbff7eb196ba54f.delta 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplrheu8a3/27d650ce0e83488f8fbff7eb196ba54f.delta 1073741824" returned: 0 in 0.052s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 22:51:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72409) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 09 22:51:45 user nova-compute[72409]: INFO nova.virt.libvirt.host [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] UEFI support detected
Aug 09 22:51:45 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:51:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:51:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-9fce283c-f8da-4dd8-89be-64eba9d8486c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:51:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-9fce283c-f8da-4dd8-89be-64eba9d8486c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:51:45 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Updating instance_info_cache with network_info: [{"id": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "address": "fa:16:3e:ca:9c:28", "network": {"id": "ef3bb213-7287-443e-b97d-654b3ebcca75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1567428712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27add12a1694aca8e1f122407e0fa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf731f-0d", "ovs_interfaceid": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-9fce283c-f8da-4dd8-89be-64eba9d8486c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:51:46 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 22:51:46 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplrheu8a3/27d650ce0e83488f8fbff7eb196ba54f.delta /opt/stack/data/nova/instances/snapshots/tmplrheu8a3/27d650ce0e83488f8fbff7eb196ba54f {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:46 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:51:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplrheu8a3/27d650ce0e83488f8fbff7eb196ba54f.delta /opt/stack/data/nova/instances/snapshots/tmplrheu8a3/27d650ce0e83488f8fbff7eb196ba54f" returned: 0 in 0.421s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:47 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Snapshot extracted, beginning image upload
Aug 09 22:51:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:51:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:49 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Snapshot image upload complete
Aug 09 22:51:49 user nova-compute[72409]: INFO nova.compute.manager [None req-6a8f708c-b829-42b9-ad05-14f27885231a tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Took 5.21 seconds to snapshot the instance on the hypervisor.
Aug 09 22:51:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:50 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:51:50 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=6905MB free_disk=25.678237915039062GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 9fce283c-f8da-4dd8-89be-64eba9d8486c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5af7f4c7-5937-4b69-831e-941d7de4417d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7b252875-ae91-4f8c-ae44-71097f9809a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7297de80-2674-4d9e-88e7-7a809bcf7381 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 29a04807-1c46-4546-b78c-73d4f2b86c46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 162c9bef-7efd-480c-b49f-64c4c8f2616d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:51:50 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Creating image(s)
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Ensure instance console log exists: /opt/stack/data/nova/instances/162c9bef-7efd-480c-b49f-64c4c8f2616d/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Start _get_guest_xml network_info=[{"id": "98877804-c6b5-45ed-b69b-c502a0936e00", "address": "fa:16:3e:0e:72:1d", "network": {"id": "4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-190846153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98877804-c6", "ovs_interfaceid": "98877804-c6b5-45ed-b69b-c502a0936e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "444f3835-540e-46ee-beb4-584610fa1054", "address": "fa:16:3e:54:71:95", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444f3835-54", "ovs_interfaceid": "444f3835-540e-46ee-beb4-584610fa1054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "address": "fa:16:3e:ec:64:0c", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e288dc-da", "ovs_interfaceid": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b031157-67a0-4cb0-960e-17042f18cf38", "address": "fa:16:3e:3b:28:a1", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b031157-67", "ovs_interfaceid": "2b031157-67a0-4cb0-960e-17042f18cf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "address": "fa:16:3e:f1:b5:12", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c682de9-37", "ovs_interfaceid": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "address": "fa:16:3e:29:4e:3e", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap755a9a96-52", "ovs_interfaceid": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f41052-45b3-4f52-81a2-854a211e59b0", "address": "fa:16:3e:50:07:25", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f41052-45", "ovs_interfaceid": "c1f41052-45b3-4f52-81a2-854a211e59b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXpwIsxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '162c9bef-7efd-480c-b49f-64c4c8f2616d', 'attached_at': '', 'detached_at': '', 'volume_id': '40114deb-0fc7-4ddb-92a4-098bbae1c44b', 'serial': '40114deb-0fc7-4ddb-92a4-098bbae1c44b'}, 'mount_device': '/dev/vda', 'attachment_id': '00bf71e4-246a-4457-811b-d39417cf81cf', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYNQnvfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '162c9bef-7efd-480c-b49f-64c4c8f2616d', 'attached_at': '', 'detached_at': '', 'volume_id': '66d8e1b3-2d63-42b8-88d8-31039efe58b8', 'serial': '66d8e1b3-2d63-42b8-88d8-31039efe58b8'}, 'mount_device': '/dev/vdb', 'attachment_id': 'f01514a9-ca14-4120-b735-34024f60b204', 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdoKSmRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '162c9bef-7efd-480c-b49f-64c4c8f2616d', 'attached_at': '', 'detached_at': '', 'volume_id': '3971a75c-ba13-46c7-86ac-7992e186ffbf', 'serial': '3971a75c-ba13-46c7-86ac-7992e186ffbf'}, 'mount_device': '/dev/vdc', 'attachment_id': 'ec59bde3-c44a-4fd5-9bf8-cd3a2908be91', 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:51:51 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:51:51 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXpwIsxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:51:51 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:51:51 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:51:51 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[189f1eea-cff8-4fd7-826a-f36a916ac58b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:51:51 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c666777-cf3a-405c-a234-f629540b077e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b] added
Aug 09 22:51:51 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8901b96-5e86-44df-ba0b-c18f9ce845ac]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb75369c-ed6e-448f-938a-31a23972d496]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXpwIsxk {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXpwIsxk" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a68d0ba-ae43-43cb-b6a3-584f1fe42b30]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXpwIsxk'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7cfa5a-0c95-47b9-8af9-3a807ea2ee75]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b6042b-2fe6-4011-a3cd-b69775b7f849]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:51 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:51 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52122ac-a807-40b0-aede-93dccd27eeb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b, portal: 172.16.0.220,3260]
Aug 09 22:51:51 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b, portal: 172.16.0.220,3260] successful.
Aug 09 22:51:51 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ad0309-a4b7-4907-9afc-355a7bdda068]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d183bd-9ebe-4d83-b173-8437d4466008]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:51 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:51:51 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:51 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:51:51 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e87f9ac-fb98-4cc2-9e9b-d3d2d432227c]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXpwIsxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 22:51:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23030396531656235', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030396531656235', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYNQnvfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:51:52 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:51:52 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:51:52 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[184ac664-6273-4ec5-a3a3-85dc1b64f9a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:51:52 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c86cee-9c48-4958-9c9a-e52781b1a941]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8] added
Aug 09 22:51:52 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5241e8f1-fef7-41ad-803d-a872aff3a750]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "9fce283c-f8da-4dd8-89be-64eba9d8486c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5388c0de-cb54-4f22-81ca-849122b20115]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYNQnvfI {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG nova.objects.instance [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lazy-loading 'flavor' on Instance uuid 9fce283c-f8da-4dd8-89be-64eba9d8486c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYNQnvfI" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5d499b-8a76-45a8-9b84-0184bd16370a]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GYNQnvfI'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c512f15-c5e2-4089-ba7d-bcc3a8b9522e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a702db1-f3fd-45e2-91c0-536156700940]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:52 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:51:52 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:52 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:51:52 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767311b-82d7-40eb-8163-68c3dbd4822e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8, portal: 172.16.0.220,3260]
Aug 09 22:51:52 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8, portal: 172.16.0.220,3260] successful.
Aug 09 22:51:52 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5f594b-6c9a-4001-90b3-876b7a484538]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c73e62-9e85-4540-ac29-f0a9b360629c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:52 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:51:52 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:51:52 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:52 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:51:52 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:51:52 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c865bce8-6791-47a0-8a62-e755ee40157e]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYNQnvfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "9fce283c-f8da-4dd8-89be-64eba9d8486c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:52 user nova-compute[72409]: INFO nova.compute.manager [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Attaching volume b3a671df-49c2-404c-88e8-204d7831cc5b to /dev/vdb
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.utils [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cef9d15-7ae0-4688-81f6-ccdd87bc19dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e29738-562e-4c4e-99a5-b1e09a5cbcb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fc44b9-5515-47c4-82b7-931e23b94ddd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5570f32-385e-4ea3-b2eb-9c21c9c142d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:51:52 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:51:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6566d6-e4dc-4c2c-9671-814c2c0bb4ec]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG os_brick.utils [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:51:52 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Updating existing volume attachment record: 8ebe6d56-362c-4fae-b2bc-f74acc06f850 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23638333033653962', 'path': '/dev/sdd'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638333033653962', 'path': '/dev/sdd'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdoKSmRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:51:53 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:51:53 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:51:53 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aa4177-6349-4b40-a27b-8a9ce78b960b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:51:53 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[669c5d17-1f3d-47af-9da0-9ee92c981fbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf] added
Aug 09 22:51:53 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d539b0-b6e4-488c-a835-625835b2a81e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bd4294-4b33-4040-8400-b4d45305413d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdoKSmRF {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdoKSmRF" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37f4bb6-05f7-4fdf-8b3d-492f31b8f2b9]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdoKSmRF'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8271b8-bb93-4a18-830b-17457a24b751]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33a4a76-7e0d-478b-b027-3d2279dfa2f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:53 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:51:53 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:51:53 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:53 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:51:53 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:51:53 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe13f37c-7637-4678-88c4-25cf43358e8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf, portal: 172.16.0.220,3260]
Aug 09 22:51:53 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf, portal: 172.16.0.220,3260] successful.
Aug 09 22:51:53 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[be67c23f-8e9e-4b58-b258-10ff7c667993]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06f9283-a66b-4fa0-8e6b-8633aef27a17]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:54 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:51:54 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:51:54 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:51:54 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:51:54 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:51:54 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:51:54 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:51:54 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b379951-e235-4bbd-b60f-b6b7c30b706e]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:51:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdoKSmRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23633326463363339', 'path': '/dev/sde'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633326463363339', 'path': '/dev/sde'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98877804-c6b5-45ed-b69b-c502a0936e00", "address": "fa:16:3e:0e:72:1d", "network": {"id": "4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-190846153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98877804-c6", "ovs_interfaceid": "98877804-c6b5-45ed-b69b-c502a0936e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "98877804-c6b5-45ed-b69b-c502a0936e00", "address": "fa:16:3e:0e:72:1d", "network": {"id": "4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-190846153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98877804-c6", "ovs_interfaceid": "98877804-c6b5-45ed-b69b-c502a0936e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:72:1d,bridge_name='br-int',has_traffic_filtering=True,id=98877804-c6b5-45ed-b69b-c502a0936e00,network=Network(4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98877804-c6') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "444f3835-540e-46ee-beb4-584610fa1054", "address": "fa:16:3e:54:71:95", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444f3835-54", "ovs_interfaceid": "444f3835-540e-46ee-beb4-584610fa1054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "444f3835-540e-46ee-beb4-584610fa1054", "address": "fa:16:3e:54:71:95", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444f3835-54", "ovs_interfaceid": "444f3835-540e-46ee-beb4-584610fa1054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:71:95,bridge_name='br-int',has_traffic_filtering=True,id=444f3835-540e-46ee-beb4-584610fa1054,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap444f3835-54') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "address": "fa:16:3e:ec:64:0c", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e288dc-da", "ovs_interfaceid": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "address": "fa:16:3e:ec:64:0c", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e288dc-da", "ovs_interfaceid": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:64:0c,bridge_name='br-int',has_traffic_filtering=True,id=91e288dc-da9b-4aa3-b687-e3d5d3c3a300,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91e288dc-da') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b031157-67a0-4cb0-960e-17042f18cf38", "address": "fa:16:3e:3b:28:a1", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b031157-67", "ovs_interfaceid": "2b031157-67a0-4cb0-960e-17042f18cf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "2b031157-67a0-4cb0-960e-17042f18cf38", "address": "fa:16:3e:3b:28:a1", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b031157-67", "ovs_interfaceid": "2b031157-67a0-4cb0-960e-17042f18cf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b031157-67a0-4cb0-960e-17042f18cf38,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b031157-67') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "address": "fa:16:3e:f1:b5:12", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c682de9-37", "ovs_interfaceid": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "address": "fa:16:3e:f1:b5:12", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c682de9-37", "ovs_interfaceid": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b5:12,bridge_name='br-int',has_traffic_filtering=True,id=3c682de9-37e0-4a27-8ae6-f24fdd328d65,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c682de9-37') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "address": "fa:16:3e:29:4e:3e", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap755a9a96-52", "ovs_interfaceid": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "address": "fa:16:3e:29:4e:3e", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap755a9a96-52", "ovs_interfaceid": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:4e:3e,bridge_name='br-int',has_traffic_filtering=True,id=755a9a96-5271-4a79-b6ef-a2c2d4f843cf,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap755a9a96-52') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1f41052-45b3-4f52-81a2-854a211e59b0", "address": "fa:16:3e:50:07:25", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f41052-45", "ovs_interfaceid": "c1f41052-45b3-4f52-81a2-854a211e59b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "c1f41052-45b3-4f52-81a2-854a211e59b0", "address": "fa:16:3e:50:07:25", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f41052-45", "ovs_interfaceid": "c1f41052-45b3-4f52-81a2-854a211e59b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:07:25,bridge_name='br-int',has_traffic_filtering=True,id=c1f41052-45b3-4f52-81a2-854a211e59b0,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f41052-45') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lazy-loading 'pci_devices' on Instance uuid 162c9bef-7efd-480c-b49f-64c4c8f2616d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:51:55 user nova-compute[72409]:   <uuid>162c9bef-7efd-480c-b49f-64c4c8f2616d</uuid>
Aug 09 22:51:55 user nova-compute[72409]:   <name>instance-0000000b</name>
Aug 09 22:51:55 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:51:55 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:51:55 user nova-compute[72409]:   <metadata>
Aug 09 22:51:55 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:51:55 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:51:55 user nova-compute[72409]:       <nova:name>tempest-device-tagging-server-2117004445</nova:name>
Aug 09 22:51:55 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:51:51</nova:creationTime>
Aug 09 22:51:55 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:51:55 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:51:55 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:51:55 user nova-compute[72409]:       <nova:owner>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:user uuid="171e03db44fd471cb22befd584e5b8b4">tempest-TaggedBootDevicesTest-1203159757-project-member</nova:user>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:project uuid="102ecfc42f6141e79caca70bf05fb91c">tempest-TaggedBootDevicesTest-1203159757</nova:project>
Aug 09 22:51:55 user nova-compute[72409]:       </nova:owner>
Aug 09 22:51:55 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:51:55 user nova-compute[72409]:       <nova:ports>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:port uuid="98877804-c6b5-45ed-b69b-c502a0936e00">
Aug 09 22:51:55 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 22:51:55 user nova-compute[72409]:         </nova:port>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:port uuid="444f3835-540e-46ee-beb4-584610fa1054">
Aug 09 22:51:55 user nova-compute[72409]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Aug 09 22:51:55 user nova-compute[72409]:         </nova:port>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:port uuid="91e288dc-da9b-4aa3-b687-e3d5d3c3a300">
Aug 09 22:51:55 user nova-compute[72409]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Aug 09 22:51:55 user nova-compute[72409]:         </nova:port>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:port uuid="2b031157-67a0-4cb0-960e-17042f18cf38">
Aug 09 22:51:55 user nova-compute[72409]:           <nova:ip type="fixed" address="10.1.1.45" ipVersion="4"/>
Aug 09 22:51:55 user nova-compute[72409]:         </nova:port>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:port uuid="3c682de9-37e0-4a27-8ae6-f24fdd328d65">
Aug 09 22:51:55 user nova-compute[72409]:           <nova:ip type="fixed" address="10.1.1.209" ipVersion="4"/>
Aug 09 22:51:55 user nova-compute[72409]:         </nova:port>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:port uuid="755a9a96-5271-4a79-b6ef-a2c2d4f843cf">
Aug 09 22:51:55 user nova-compute[72409]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 22:51:55 user nova-compute[72409]:         </nova:port>
Aug 09 22:51:55 user nova-compute[72409]:         <nova:port uuid="c1f41052-45b3-4f52-81a2-854a211e59b0">
Aug 09 22:51:55 user nova-compute[72409]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 22:51:55 user nova-compute[72409]:         </nova:port>
Aug 09 22:51:55 user nova-compute[72409]:       </nova:ports>
Aug 09 22:51:55 user nova-compute[72409]:     </nova:instance>
Aug 09 22:51:55 user nova-compute[72409]:   </metadata>
Aug 09 22:51:55 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:51:55 user nova-compute[72409]:     <system>
Aug 09 22:51:55 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:51:55 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:51:55 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:51:55 user nova-compute[72409]:       <entry name="serial">162c9bef-7efd-480c-b49f-64c4c8f2616d</entry>
Aug 09 22:51:55 user nova-compute[72409]:       <entry name="uuid">162c9bef-7efd-480c-b49f-64c4c8f2616d</entry>
Aug 09 22:51:55 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:51:55 user nova-compute[72409]:     </system>
Aug 09 22:51:55 user nova-compute[72409]:   </sysinfo>
Aug 09 22:51:55 user nova-compute[72409]:   <os>
Aug 09 22:51:55 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:51:55 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:51:55 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:51:55 user nova-compute[72409]:   </os>
Aug 09 22:51:55 user nova-compute[72409]:   <features>
Aug 09 22:51:55 user nova-compute[72409]:     <acpi/>
Aug 09 22:51:55 user nova-compute[72409]:     <apic/>
Aug 09 22:51:55 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:51:55 user nova-compute[72409]:   </features>
Aug 09 22:51:55 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:51:55 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:51:55 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:51:55 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:51:55 user nova-compute[72409]:   </clock>
Aug 09 22:51:55 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:51:55 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:51:55 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:51:55 user nova-compute[72409]:   </cpu>
Aug 09 22:51:55 user nova-compute[72409]:   <devices>
Aug 09 22:51:55 user nova-compute[72409]:     <disk type="file" device="cdrom">
Aug 09 22:51:55 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 22:51:55 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/162c9bef-7efd-480c-b49f-64c4c8f2616d/disk.config"/>
Aug 09 22:51:55 user nova-compute[72409]:       <target dev="hda" bus="ide"/>
Aug 09 22:51:55 user nova-compute[72409]:     </disk>
Aug 09 22:51:55 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:51:55 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:51:55 user nova-compute[72409]:       <source dev="/dev/sdc"/>
Aug 09 22:51:55 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:51:55 user nova-compute[72409]:       <serial>40114deb-0fc7-4ddb-92a4-098bbae1c44b</serial>
Aug 09 22:51:55 user nova-compute[72409]:     </disk>
Aug 09 22:51:55 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:51:55 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:51:55 user nova-compute[72409]:       <source dev="/dev/sdd"/>
Aug 09 22:51:55 user nova-compute[72409]:       <target dev="vdb" bus="virtio"/>
Aug 09 22:51:55 user nova-compute[72409]:       <serial>66d8e1b3-2d63-42b8-88d8-31039efe58b8</serial>
Aug 09 22:51:55 user nova-compute[72409]:     </disk>
Aug 09 22:51:55 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:51:55 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:51:55 user nova-compute[72409]:       <source dev="/dev/sde"/>
Aug 09 22:51:55 user nova-compute[72409]:       <target dev="vdc" bus="virtio"/>
Aug 09 22:51:55 user nova-compute[72409]:       <serial>3971a75c-ba13-46c7-86ac-7992e186ffbf</serial>
Aug 09 22:51:55 user nova-compute[72409]:     </disk>
Aug 09 22:51:55 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:51:55 user nova-compute[72409]:       <mac address="fa:16:3e:0e:72:1d"/>
Aug 09 22:51:55 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:51:55 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:51:55 user nova-compute[72409]:       <target dev="tap98877804-c6"/>
Aug 09 22:51:55 user nova-compute[72409]:     </interface>
Aug 09 22:51:55 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:51:55 user nova-compute[72409]:       <mac address="fa:16:3e:54:71:95"/>
Aug 09 22:51:55 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:51:55 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:51:55 user nova-compute[72409]:       <target dev="tap444f3835-54"/>
Aug 09 22:51:55 user nova-compute[72409]:     </interface>
Aug 09 22:51:55 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:51:55 user nova-compute[72409]:       <mac address="fa:16:3e:ec:64:0c"/>
Aug 09 22:51:55 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:51:55 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:51:55 user nova-compute[72409]:       <target dev="tap91e288dc-da"/>
Aug 09 22:51:55 user nova-compute[72409]:     </interface>
Aug 09 22:51:55 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:51:55 user nova-compute[72409]:       <mac address="fa:16:3e:3b:28:a1"/>
Aug 09 22:51:55 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:51:55 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:51:55 user nova-compute[72409]:       <target dev="tap2b031157-67"/>
Aug 09 22:51:55 user nova-compute[72409]:     </interface>
Aug 09 22:51:55 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:51:55 user nova-compute[72409]:       <mac address="fa:16:3e:f1:b5:12"/>
Aug 09 22:51:55 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:51:55 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:51:55 user nova-compute[72409]:       <target dev="tap3c682de9-37"/>
Aug 09 22:51:55 user nova-compute[72409]:     </interface>
Aug 09 22:51:55 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:51:55 user nova-compute[72409]:       <mac address="fa:16:3e:29:4e:3e"/>
Aug 09 22:51:55 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:51:55 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:51:55 user nova-compute[72409]:       <target dev="tap755a9a96-52"/>
Aug 09 22:51:55 user nova-compute[72409]:     </interface>
Aug 09 22:51:55 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:51:55 user nova-compute[72409]:       <mac address="fa:16:3e:50:07:25"/>
Aug 09 22:51:55 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:51:55 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:51:55 user nova-compute[72409]:       <target dev="tapc1f41052-45"/>
Aug 09 22:51:55 user nova-compute[72409]:     </interface>
Aug 09 22:51:55 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:51:55 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/162c9bef-7efd-480c-b49f-64c4c8f2616d/console.log" append="off"/>
Aug 09 22:51:55 user nova-compute[72409]:     </serial>
Aug 09 22:51:55 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:51:55 user nova-compute[72409]:     <video>
Aug 09 22:51:55 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:51:55 user nova-compute[72409]:     </video>
Aug 09 22:51:55 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:51:55 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:51:55 user nova-compute[72409]:     </rng>
Aug 09 22:51:55 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:51:55 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:51:55 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:51:55 user nova-compute[72409]:     </memballoon>
Aug 09 22:51:55 user nova-compute[72409]:   </devices>
Aug 09 22:51:55 user nova-compute[72409]: </domain>
Aug 09 22:51:55 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98877804-c6b5-45ed-b69b-c502a0936e00", "address": "fa:16:3e:0e:72:1d", "network": {"id": "4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-190846153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98877804-c6", "ovs_interfaceid": "98877804-c6b5-45ed-b69b-c502a0936e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "98877804-c6b5-45ed-b69b-c502a0936e00", "address": "fa:16:3e:0e:72:1d", "network": {"id": "4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-190846153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98877804-c6", "ovs_interfaceid": "98877804-c6b5-45ed-b69b-c502a0936e00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:72:1d,bridge_name='br-int',has_traffic_filtering=True,id=98877804-c6b5-45ed-b69b-c502a0936e00,network=Network(4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98877804-c6') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:72:1d,bridge_name='br-int',has_traffic_filtering=True,id=98877804-c6b5-45ed-b69b-c502a0936e00,network=Network(4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98877804-c6') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-c1559701-c3fd-417e-aba2-bd57101c7b13 req-b2ce3fa7-41cc-4d6e-aec8-28d38813e233 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-changed-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-c1559701-c3fd-417e-aba2-bd57101c7b13 req-b2ce3fa7-41cc-4d6e-aec8-28d38813e233 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Refreshing instance network info cache due to event network-changed-073bad5c-1f38-4fb0-b4e9-803dd62fcd34. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c1559701-c3fd-417e-aba2-bd57101c7b13 req-b2ce3fa7-41cc-4d6e-aec8-28d38813e233 service nova] Acquiring lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c1559701-c3fd-417e-aba2-bd57101c7b13 req-b2ce3fa7-41cc-4d6e-aec8-28d38813e233 service nova] Acquired lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.neutron [req-c1559701-c3fd-417e-aba2-bd57101c7b13 req-b2ce3fa7-41cc-4d6e-aec8-28d38813e233 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Refreshing network info cache for port 073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98877804-c6, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98877804-c6, col_values=(('external_ids', {'iface-id': '98877804-c6b5-45ed-b69b-c502a0936e00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:72:1d', 'vm-uuid': '162c9bef-7efd-480c-b49f-64c4c8f2616d'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: INFO os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:72:1d,bridge_name='br-int',has_traffic_filtering=True,id=98877804-c6b5-45ed-b69b-c502a0936e00,network=Network(4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98877804-c6')
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "444f3835-540e-46ee-beb4-584610fa1054", "address": "fa:16:3e:54:71:95", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444f3835-54", "ovs_interfaceid": "444f3835-540e-46ee-beb4-584610fa1054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "444f3835-540e-46ee-beb4-584610fa1054", "address": "fa:16:3e:54:71:95", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444f3835-54", "ovs_interfaceid": "444f3835-540e-46ee-beb4-584610fa1054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:71:95,bridge_name='br-int',has_traffic_filtering=True,id=444f3835-540e-46ee-beb4-584610fa1054,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap444f3835-54') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:71:95,bridge_name='br-int',has_traffic_filtering=True,id=444f3835-540e-46ee-beb4-584610fa1054,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap444f3835-54') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap444f3835-54, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap444f3835-54, col_values=(('external_ids', {'iface-id': '444f3835-540e-46ee-beb4-584610fa1054', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:71:95', 'vm-uuid': '162c9bef-7efd-480c-b49f-64c4c8f2616d'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: INFO os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:71:95,bridge_name='br-int',has_traffic_filtering=True,id=444f3835-540e-46ee-beb4-584610fa1054,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap444f3835-54')
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "address": "fa:16:3e:ec:64:0c", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e288dc-da", "ovs_interfaceid": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "address": "fa:16:3e:ec:64:0c", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e288dc-da", "ovs_interfaceid": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:64:0c,bridge_name='br-int',has_traffic_filtering=True,id=91e288dc-da9b-4aa3-b687-e3d5d3c3a300,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91e288dc-da') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:64:0c,bridge_name='br-int',has_traffic_filtering=True,id=91e288dc-da9b-4aa3-b687-e3d5d3c3a300,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91e288dc-da') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91e288dc-da, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91e288dc-da, col_values=(('external_ids', {'iface-id': '91e288dc-da9b-4aa3-b687-e3d5d3c3a300', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:64:0c', 'vm-uuid': '162c9bef-7efd-480c-b49f-64c4c8f2616d'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: INFO os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:64:0c,bridge_name='br-int',has_traffic_filtering=True,id=91e288dc-da9b-4aa3-b687-e3d5d3c3a300,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91e288dc-da')
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b031157-67a0-4cb0-960e-17042f18cf38", "address": "fa:16:3e:3b:28:a1", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b031157-67", "ovs_interfaceid": "2b031157-67a0-4cb0-960e-17042f18cf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "2b031157-67a0-4cb0-960e-17042f18cf38", "address": "fa:16:3e:3b:28:a1", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b031157-67", "ovs_interfaceid": "2b031157-67a0-4cb0-960e-17042f18cf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b031157-67a0-4cb0-960e-17042f18cf38,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b031157-67') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b031157-67a0-4cb0-960e-17042f18cf38,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b031157-67') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b031157-67, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b031157-67, col_values=(('external_ids', {'iface-id': '2b031157-67a0-4cb0-960e-17042f18cf38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:28:a1', 'vm-uuid': '162c9bef-7efd-480c-b49f-64c4c8f2616d'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: INFO os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b031157-67a0-4cb0-960e-17042f18cf38,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b031157-67')
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "address": "fa:16:3e:f1:b5:12", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c682de9-37", "ovs_interfaceid": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "address": "fa:16:3e:f1:b5:12", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c682de9-37", "ovs_interfaceid": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b5:12,bridge_name='br-int',has_traffic_filtering=True,id=3c682de9-37e0-4a27-8ae6-f24fdd328d65,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c682de9-37') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b5:12,bridge_name='br-int',has_traffic_filtering=True,id=3c682de9-37e0-4a27-8ae6-f24fdd328d65,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c682de9-37') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c682de9-37, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c682de9-37, col_values=(('external_ids', {'iface-id': '3c682de9-37e0-4a27-8ae6-f24fdd328d65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:b5:12', 'vm-uuid': '162c9bef-7efd-480c-b49f-64c4c8f2616d'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: INFO os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b5:12,bridge_name='br-int',has_traffic_filtering=True,id=3c682de9-37e0-4a27-8ae6-f24fdd328d65,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c682de9-37')
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "address": "fa:16:3e:29:4e:3e", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap755a9a96-52", "ovs_interfaceid": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "address": "fa:16:3e:29:4e:3e", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap755a9a96-52", "ovs_interfaceid": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:4e:3e,bridge_name='br-int',has_traffic_filtering=True,id=755a9a96-5271-4a79-b6ef-a2c2d4f843cf,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap755a9a96-52') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:4e:3e,bridge_name='br-int',has_traffic_filtering=True,id=755a9a96-5271-4a79-b6ef-a2c2d4f843cf,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap755a9a96-52') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap755a9a96-52, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap755a9a96-52, col_values=(('external_ids', {'iface-id': '755a9a96-5271-4a79-b6ef-a2c2d4f843cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:4e:3e', 'vm-uuid': '162c9bef-7efd-480c-b49f-64c4c8f2616d'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: INFO os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:4e:3e,bridge_name='br-int',has_traffic_filtering=True,id=755a9a96-5271-4a79-b6ef-a2c2d4f843cf,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap755a9a96-52')
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1f41052-45b3-4f52-81a2-854a211e59b0", "address": "fa:16:3e:50:07:25", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f41052-45", "ovs_interfaceid": "c1f41052-45b3-4f52-81a2-854a211e59b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "c1f41052-45b3-4f52-81a2-854a211e59b0", "address": "fa:16:3e:50:07:25", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f41052-45", "ovs_interfaceid": "c1f41052-45b3-4f52-81a2-854a211e59b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:07:25,bridge_name='br-int',has_traffic_filtering=True,id=c1f41052-45b3-4f52-81a2-854a211e59b0,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f41052-45') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:07:25,bridge_name='br-int',has_traffic_filtering=True,id=c1f41052-45b3-4f52-81a2-854a211e59b0,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f41052-45') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1f41052-45, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1f41052-45, col_values=(('external_ids', {'iface-id': 'c1f41052-45b3-4f52-81a2-854a211e59b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:07:25', 'vm-uuid': '162c9bef-7efd-480c-b49f-64c4c8f2616d'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:55 user nova-compute[72409]: INFO os_vif [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:07:25,bridge_name='br-int',has_traffic_filtering=True,id=c1f41052-45b3-4f52-81a2-854a211e59b0,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f41052-45')
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] No BDM found with device name hda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] No VIF found with MAC fa:16:3e:0e:72:1d, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] No VIF found with MAC fa:16:3e:f1:b5:12, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:51:55 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Using config drive
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.neutron [req-c1559701-c3fd-417e-aba2-bd57101c7b13 req-b2ce3fa7-41cc-4d6e-aec8-28d38813e233 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updated VIF entry in instance network info cache for port 073bad5c-1f38-4fb0-b4e9-803dd62fcd34. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG nova.network.neutron [req-c1559701-c3fd-417e-aba2-bd57101c7b13 req-b2ce3fa7-41cc-4d6e-aec8-28d38813e233 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updating instance_info_cache with network_info: [{"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c1559701-c3fd-417e-aba2-bd57101c7b13 req-b2ce3fa7-41cc-4d6e-aec8-28d38813e233 service nova] Releasing lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:51:55 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Creating config drive at /opt/stack/data/nova/instances/162c9bef-7efd-480c-b49f-64c4c8f2616d/disk.config
Aug 09 22:51:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/162c9bef-7efd-480c-b49f-64c4c8f2616d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzcetumum {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/162c9bef-7efd-480c-b49f-64c4c8f2616d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzcetumum" returned: 0 in 0.062s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:51:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-4a3a6953-fea0-458c-bbbe-e618fba34b3c req-269620f1-06af-4b8f-afa9-5034096cea62 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4a3a6953-fea0-458c-bbbe-e618fba34b3c req-269620f1-06af-4b8f-afa9-5034096cea62 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4a3a6953-fea0-458c-bbbe-e618fba34b3c req-269620f1-06af-4b8f-afa9-5034096cea62 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4a3a6953-fea0-458c-bbbe-e618fba34b3c req-269620f1-06af-4b8f-afa9-5034096cea62 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-4a3a6953-fea0-458c-bbbe-e618fba34b3c req-269620f1-06af-4b8f-afa9-5034096cea62 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:51:57 user nova-compute[72409]: WARNING nova.compute.manager [req-4a3a6953-fea0-458c-bbbe-e618fba34b3c req-269620f1-06af-4b8f-afa9-5034096cea62 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-98877804-c6b5-45ed-b69b-c502a0936e00 for instance with vm_state building and task_state spawning.
Aug 09 22:51:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-6a904384-138f-48fd-801e-313c5d182289 req-71dbf1a6-8d9e-4fea-9c22-068ce0c65b86 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a904384-138f-48fd-801e-313c5d182289 req-71dbf1a6-8d9e-4fea-9c22-068ce0c65b86 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a904384-138f-48fd-801e-313c5d182289 req-71dbf1a6-8d9e-4fea-9c22-068ce0c65b86 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a904384-138f-48fd-801e-313c5d182289 req-71dbf1a6-8d9e-4fea-9c22-068ce0c65b86 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-6a904384-138f-48fd-801e-313c5d182289 req-71dbf1a6-8d9e-4fea-9c22-068ce0c65b86 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:51:59 user nova-compute[72409]: WARNING nova.compute.manager [req-6a904384-138f-48fd-801e-313c5d182289 req-71dbf1a6-8d9e-4fea-9c22-068ce0c65b86 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-3c682de9-37e0-4a27-8ae6-f24fdd328d65 for instance with vm_state building and task_state spawning.
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-abab822e-c742-4fc3-8f9d-f664a1faed40 req-81559199-ab8d-452f-9e67-26afbd7ec042 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-abab822e-c742-4fc3-8f9d-f664a1faed40 req-81559199-ab8d-452f-9e67-26afbd7ec042 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-abab822e-c742-4fc3-8f9d-f664a1faed40 req-81559199-ab8d-452f-9e67-26afbd7ec042 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-abab822e-c742-4fc3-8f9d-f664a1faed40 req-81559199-ab8d-452f-9e67-26afbd7ec042 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-abab822e-c742-4fc3-8f9d-f664a1faed40 req-81559199-ab8d-452f-9e67-26afbd7ec042 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:51:59 user nova-compute[72409]: WARNING nova.compute.manager [req-abab822e-c742-4fc3-8f9d-f664a1faed40 req-81559199-ab8d-452f-9e67-26afbd7ec042 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-755a9a96-5271-4a79-b6ef-a2c2d4f843cf for instance with vm_state building and task_state spawning.
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:51:59 user nova-compute[72409]: WARNING nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-98877804-c6b5-45ed-b69b-c502a0936e00 for instance with vm_state building and task_state spawning.
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-444f3835-540e-46ee-beb4-584610fa1054 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-444f3835-540e-46ee-beb4-584610fa1054 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:51:59 user nova-compute[72409]: WARNING nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-444f3835-540e-46ee-beb4-584610fa1054 for instance with vm_state building and task_state spawning.
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-444f3835-540e-46ee-beb4-584610fa1054 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-444f3835-540e-46ee-beb4-584610fa1054 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:51:59 user nova-compute[72409]: WARNING nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-444f3835-540e-46ee-beb4-584610fa1054 for instance with vm_state building and task_state spawning.
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:51:59 user nova-compute[72409]: WARNING nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 for instance with vm_state building and task_state spawning.
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:51:59 user nova-compute[72409]: WARNING nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 for instance with vm_state building and task_state spawning.
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:51:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:51:59 user nova-compute[72409]: WARNING nova.compute.manager [req-21d1e883-8cab-492a-9f8c-d19c47333e6f req-ed7461e6-54f5-49c2-a08e-daa317414d17 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-2b031157-67a0-4cb0-960e-17042f18cf38 for instance with vm_state building and task_state spawning.
Aug 09 22:52:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-591accf3-9416-4f59-9e50-f9e05e0f2c9f req-f0fb566e-e3e4-44d2-8016-3bf0bc26c2ef service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-591accf3-9416-4f59-9e50-f9e05e0f2c9f req-f0fb566e-e3e4-44d2-8016-3bf0bc26c2ef service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-591accf3-9416-4f59-9e50-f9e05e0f2c9f req-f0fb566e-e3e4-44d2-8016-3bf0bc26c2ef service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-591accf3-9416-4f59-9e50-f9e05e0f2c9f req-f0fb566e-e3e4-44d2-8016-3bf0bc26c2ef service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-591accf3-9416-4f59-9e50-f9e05e0f2c9f req-f0fb566e-e3e4-44d2-8016-3bf0bc26c2ef service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:01 user nova-compute[72409]: WARNING nova.compute.manager [req-591accf3-9416-4f59-9e50-f9e05e0f2c9f req-f0fb566e-e3e4-44d2-8016-3bf0bc26c2ef service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-3c682de9-37e0-4a27-8ae6-f24fdd328d65 for instance with vm_state building and task_state spawning.
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:01 user nova-compute[72409]: INFO nova.compute.manager [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Shelving
Aug 09 22:52:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-cae53f4b-75ad-4395-b081-23b4d29d14bb req-8fad1bfd-096c-4d27-9211-dd80f67d3ef7 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cae53f4b-75ad-4395-b081-23b4d29d14bb req-8fad1bfd-096c-4d27-9211-dd80f67d3ef7 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cae53f4b-75ad-4395-b081-23b4d29d14bb req-8fad1bfd-096c-4d27-9211-dd80f67d3ef7 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cae53f4b-75ad-4395-b081-23b4d29d14bb req-8fad1bfd-096c-4d27-9211-dd80f67d3ef7 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-cae53f4b-75ad-4395-b081-23b4d29d14bb req-8fad1bfd-096c-4d27-9211-dd80f67d3ef7 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:01 user nova-compute[72409]: WARNING nova.compute.manager [req-cae53f4b-75ad-4395-b081-23b4d29d14bb req-8fad1bfd-096c-4d27-9211-dd80f67d3ef7 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-755a9a96-5271-4a79-b6ef-a2c2d4f843cf for instance with vm_state building and task_state spawning.
Aug 09 22:52:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:01 user nova-compute[72409]: WARNING nova.compute.manager [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-2b031157-67a0-4cb0-960e-17042f18cf38 for instance with vm_state building and task_state spawning.
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:01 user nova-compute[72409]: WARNING nova.compute.manager [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-c1f41052-45b3-4f52-81a2-854a211e59b0 for instance with vm_state building and task_state spawning.
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:01 user nova-compute[72409]: WARNING nova.compute.manager [req-9a253fae-221b-4b53-a78d-23355f306541 req-8598611b-39ce-444e-a56c-78ae798c0e50 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-c1f41052-45b3-4f52-81a2-854a211e59b0 for instance with vm_state building and task_state spawning.
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621521.9524562, 162c9bef-7efd-480c-b49f-64c4c8f2616d => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:52:01 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] VM Resumed (Lifecycle Event)
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:52:01 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Instance spawned successfully.
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:52:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:52:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:52:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:52:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:52:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:52:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:52:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:52:02 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:52:02 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621521.9569588, 162c9bef-7efd-480c-b49f-64c4c8f2616d => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:52:02 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] VM Started (Lifecycle Event)
Aug 09 22:52:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:52:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:52:02 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:52:02 user nova-compute[72409]: INFO nova.compute.manager [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Took 11.10 seconds to spawn the instance on the hypervisor.
Aug 09 22:52:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:52:02 user nova-compute[72409]: INFO nova.compute.manager [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Took 43.40 seconds to build instance.
Aug 09 22:52:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c895ff85-9db5-4acc-b4d6-80e84c393646 tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.531s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Instance destroyed successfully.
Aug 09 22:52:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Beginning cold snapshot process
Aug 09 22:52:02 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 22:52:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk /opt/stack/data/nova/instances/snapshots/tmpi_0cn431/dabfb4efb83b434a900b4a132243c4f6 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAUELvuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:03 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:03 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:03 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f12a7cb-f4ca-4402-ae4f-9f05f137b771]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:52:03 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf16d67-6e69-462f-9ce7-c2c4f4537cb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b] added
Aug 09 22:52:03 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk /opt/stack/data/nova/instances/snapshots/tmpi_0cn431/dabfb4efb83b434a900b4a132243c4f6" returned: 0 in 0.644s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:03 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Snapshot extracted, beginning image upload
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e146cf5-944e-469c-abc5-60cfa4d4adff]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5040cc72-578c-4857-9edc-3e7a715ce2fb]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAUELvuM {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAUELvuM" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e926ea-07a2-4efa-80b9-5709cc0c448d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OAUELvuM'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[642fe903-b42d-41d3-956c-f1a3f178ff68]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcd28bc-9acf-4a7a-8617-fa48bbd791ec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:03 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:03 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7b25f8-09f5-4926-85ee-4dad9dc950da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b, portal: 172.16.0.220,3260]
Aug 09 22:52:03 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b, portal: 172.16.0.220,3260] successful.
Aug 09 22:52:03 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee05dccb-7502-4dc6-bc5a-d17036e198d7]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[20016836-50db-4ddb-bc41-1ef59204293a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b (non-flash)
Aug 09 22:52:03 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:03 user nova-compute[72409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b (non-flash)
Aug 09 22:52:03 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e94be7-3ee9-4311-a950-8f2db35470d6]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAUELvuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-a70d19a4-68ec-4e01-ae06-21226c09efd0 req-182e8683-0f6c-4f55-9930-703712a5b56e service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-vif-unplugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a70d19a4-68ec-4e01-ae06-21226c09efd0 req-182e8683-0f6c-4f55-9930-703712a5b56e service nova] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a70d19a4-68ec-4e01-ae06-21226c09efd0 req-182e8683-0f6c-4f55-9930-703712a5b56e service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a70d19a4-68ec-4e01-ae06-21226c09efd0 req-182e8683-0f6c-4f55-9930-703712a5b56e service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-a70d19a4-68ec-4e01-ae06-21226c09efd0 req-182e8683-0f6c-4f55-9930-703712a5b56e service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] No waiting events found dispatching network-vif-unplugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:03 user nova-compute[72409]: WARNING nova.compute.manager [req-a70d19a4-68ec-4e01-ae06-21226c09efd0 req-182e8683-0f6c-4f55-9930-703712a5b56e service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received unexpected event network-vif-unplugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 22:52:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-a70d19a4-68ec-4e01-ae06-21226c09efd0 req-182e8683-0f6c-4f55-9930-703712a5b56e service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a70d19a4-68ec-4e01-ae06-21226c09efd0 req-182e8683-0f6c-4f55-9930-703712a5b56e service nova] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a70d19a4-68ec-4e01-ae06-21226c09efd0 req-182e8683-0f6c-4f55-9930-703712a5b56e service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a70d19a4-68ec-4e01-ae06-21226c09efd0 req-182e8683-0f6c-4f55-9930-703712a5b56e service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-a70d19a4-68ec-4e01-ae06-21226c09efd0 req-182e8683-0f6c-4f55-9930-703712a5b56e service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] No waiting events found dispatching network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:03 user nova-compute[72409]: WARNING nova.compute.manager [req-a70d19a4-68ec-4e01-ae06-21226c09efd0 req-182e8683-0f6c-4f55-9930-703712a5b56e service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received unexpected event network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 22:52:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23761373030383563', 'path': '/dev/sdf'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761373030383563', 'path': '/dev/sdf'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:52:04 user nova-compute[72409]: DEBUG nova.objects.instance [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lazy-loading 'flavor' on Instance uuid 9fce283c-f8da-4dd8-89be-64eba9d8486c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 22:52:04 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:04 user nova-compute[72409]:   <source dev="/dev/sdf"/>
Aug 09 22:52:04 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:52:04 user nova-compute[72409]:   <serial>b3a671df-49c2-404c-88e8-204d7831cc5b</serial>
Aug 09 22:52:04 user nova-compute[72409]: </disk>
Aug 09 22:52:04 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 22:52:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] No VIF found with MAC fa:16:3e:ca:9c:28, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:52:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f66c9458-a8aa-4c56-b092-9f8fa43afba9 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.465s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:06 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Snapshot image upload complete
Aug 09 22:52:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:52:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "9fce283c-f8da-4dd8-89be-64eba9d8486c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:06 user nova-compute[72409]: INFO nova.compute.manager [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Terminating instance
Aug 09 22:52:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:52:06 user nova-compute[72409]: INFO nova.compute.manager [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Shelve offloading
Aug 09 22:52:06 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Instance destroyed successfully.
Aug 09 22:52:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:52:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquired lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:06 user nova-compute[72409]: DEBUG nova.network.neutron [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:52:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG nova.compute.manager [req-136a6438-a2be-4fda-bd88-1886d9a0d15d req-3dfc9095-b0e1-4ace-acd2-4502adae9597 service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Received event network-vif-unplugged-b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-136a6438-a2be-4fda-bd88-1886d9a0d15d req-3dfc9095-b0e1-4ace-acd2-4502adae9597 service nova] Acquiring lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-136a6438-a2be-4fda-bd88-1886d9a0d15d req-3dfc9095-b0e1-4ace-acd2-4502adae9597 service nova] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-136a6438-a2be-4fda-bd88-1886d9a0d15d req-3dfc9095-b0e1-4ace-acd2-4502adae9597 service nova] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG nova.compute.manager [req-136a6438-a2be-4fda-bd88-1886d9a0d15d req-3dfc9095-b0e1-4ace-acd2-4502adae9597 service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] No waiting events found dispatching network-vif-unplugged-b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG nova.compute.manager [req-136a6438-a2be-4fda-bd88-1886d9a0d15d req-3dfc9095-b0e1-4ace-acd2-4502adae9597 service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Received event network-vif-unplugged-b0cf731f-0d1d-4e89-9efb-1a12adba424f for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:07 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Instance destroyed successfully.
Aug 09 22:52:07 user nova-compute[72409]: DEBUG nova.objects.instance [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lazy-loading 'resources' on Instance uuid 9fce283c-f8da-4dd8-89be-64eba9d8486c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1376947220',display_name='tempest-DeleteServersTestJSON-server-1376947220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1376947220',id=2,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b27add12a1694aca8e1f122407e0fa1f',ramdisk_id='',reservation_id='r-qdghnz4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-965854989',owner_user_name='tempest-DeleteServersTestJSON-965854989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:50:09Z,user_data=None,user_id='5430655e937042df9acbbb835ad7374c',uuid=9fce283c-f8da-4dd8-89be-64eba9d8486c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "address": "fa:16:3e:ca:9c:28", "network": {"id": "ef3bb213-7287-443e-b97d-654b3ebcca75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1567428712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27add12a1694aca8e1f122407e0fa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf731f-0d", "ovs_interfaceid": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Converting VIF {"id": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "address": "fa:16:3e:ca:9c:28", "network": {"id": "ef3bb213-7287-443e-b97d-654b3ebcca75", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1567428712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b27add12a1694aca8e1f122407e0fa1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf731f-0d", "ovs_interfaceid": "b0cf731f-0d1d-4e89-9efb-1a12adba424f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:9c:28,bridge_name='br-int',has_traffic_filtering=True,id=b0cf731f-0d1d-4e89-9efb-1a12adba424f,network=Network(ef3bb213-7287-443e-b97d-654b3ebcca75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf731f-0d') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_vif [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:9c:28,bridge_name='br-int',has_traffic_filtering=True,id=b0cf731f-0d1d-4e89-9efb-1a12adba424f,network=Network(ef3bb213-7287-443e-b97d-654b3ebcca75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf731f-0d') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0cf731f-0d, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:07 user nova-compute[72409]: INFO os_vif [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:9c:28,bridge_name='br-int',has_traffic_filtering=True,id=b0cf731f-0d1d-4e89-9efb-1a12adba424f,network=Network(ef3bb213-7287-443e-b97d-654b3ebcca75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf731f-0d')
Aug 09 22:52:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAUELvuM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:07 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dba16bc-291f-4aaf-a945-cabf8016ff55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG nova.network.neutron [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updating instance_info_cache with network_info: [{"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Releasing lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d98f7c-9a9e-49ba-9c3d-2ed9b5d90fe2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:07 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:07 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:07 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:07 user nova-compute[72409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b (non-flash)
Aug 09 22:52:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:07 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:07 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:07 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:07 user nova-compute[72409]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b (non-flash)
Aug 09 22:52:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e943c76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b'): ({'sdf'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Removing single pathed devices sdf {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8e57ce-a497-41a5-a5b4-86b9aba2c4d7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b25e268-5f80-46fa-95b6-278feea88840]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Flushing IO for device /dev/sdf {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb8c4e7-4ed6-499b-a63f-0562b4f8ca27]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2658e562-de90-4f3e-86c9-186f90f4f616]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] SCSI volumes sdf have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[764fa12b-cf34-4a60-9e64-94e81078239a]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf7c6b3-70fc-4390-bf32-0c6663e41b4f]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b, portal: 172.16.0.220,3260]
Aug 09 22:52:08 user nova-compute[72409]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b, portal: 172.16.0.220,3260] successful.
Aug 09 22:52:08 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3a671df-49c2-404c-88e8-204d7831cc5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e1cd47-4268-47ab-96a6-14ae18e2b907]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] <== disconnect_volume: return (316ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:52:08 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Deleting instance files /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c_del
Aug 09 22:52:08 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Deletion of /opt/stack/data/nova/instances/9fce283c-f8da-4dd8-89be-64eba9d8486c_del complete
Aug 09 22:52:08 user nova-compute[72409]: INFO nova.compute.manager [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 09 22:52:08 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:52:08 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Instance destroyed successfully.
Aug 09 22:52:08 user nova-compute[72409]: DEBUG nova.objects.instance [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'resources' on Instance uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1676089071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1676089071',id=3,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWHyfVpg3Kxrgr/EOJ4QW5vmd6tAAdh2btXYWwwgqJOx2vQ/rfQRRsSJSnaWzEo8tufPFyDQFqxKUWgmDvGwm+DH3CFrgPX/YxaD+rKI415YK3kZVdGh13iXzHTaZN+EA==',key_name='tempest-keypair-996093995',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='894e6764aa794ff29ce4bc213a7def7d',ramdisk_id='',reservation_id='r-e05l9tyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-723310053',owner_user_name='tempest-AttachVolumeShelveTestJSON-723310053-project-member',shelved_at='2023-08-09T22:52:06.476335',shelved_host='user',shelved_image_id='f1f9258e-c87d-429e-8cfd-efaaf843840a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:52:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce008676a8de41b8b2ffe79ab31462df',uuid=19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converting VIF {"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG os_vif [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap073bad5c-1f, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:52:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:52:08 user nova-compute[72409]: INFO os_vif [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f')
Aug 09 22:52:08 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Deleting instance files /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8_del
Aug 09 22:52:08 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Deletion of /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8_del complete
Aug 09 22:52:08 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:08 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Took 0.79 seconds to deallocate network for instance.
Aug 09 22:52:08 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Deleted allocations for instance 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8
Aug 09 22:52:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG nova.objects.instance [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'numa_topology' on Instance uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Received event network-vif-plugged-b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] Acquiring lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] No waiting events found dispatching network-vif-plugged-b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:09 user nova-compute[72409]: WARNING nova.compute.manager [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Received unexpected event network-vif-plugged-b0cf731f-0d1d-4e89-9efb-1a12adba424f for instance with vm_state active and task_state deleting.
Aug 09 22:52:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-changed-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Refreshing instance network info cache due to event network-changed-073bad5c-1f38-4fb0-b4e9-803dd62fcd34. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] Acquiring lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] Acquired lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG nova.network.neutron [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Refreshing network info cache for port 073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-fcd6979e-e426-4a48-8218-5647c06003eb tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.888s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:09 user nova-compute[72409]: INFO nova.compute.manager [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Took 0.90 seconds to detach 1 volumes for instance.
Aug 09 22:52:09 user nova-compute[72409]: DEBUG nova.network.neutron [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updated VIF entry in instance network info cache for port 073bad5c-1f38-4fb0-b4e9-803dd62fcd34. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG nova.network.neutron [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updating instance_info_cache with network_info: [{"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap073bad5c-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] Releasing lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-9b367df3-781a-4b37-8392-b5cd45a68689 req-dd22c949-929c-45e6-acaa-afb6c9fef224 service nova] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Received event network-vif-deleted-b0cf731f-0d1d-4e89-9efb-1a12adba424f {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:10 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:52:10 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:52:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:10 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Deleted allocations for instance 9fce283c-f8da-4dd8-89be-64eba9d8486c
Aug 09 22:52:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d7c1e6cb-3b97-4613-8554-57bce2591af7 tempest-DeleteServersTestJSON-965854989 tempest-DeleteServersTestJSON-965854989-project-member] Lock "9fce283c-f8da-4dd8-89be-64eba9d8486c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.614s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-1f786ca8-8229-4d85-beba-1483a3f7040e req-186d14b6-d9ca-4c7e-b984-cf543d17b773 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Received event network-changed-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-1f786ca8-8229-4d85-beba-1483a3f7040e req-186d14b6-d9ca-4c7e-b984-cf543d17b773 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Refreshing instance network info cache due to event network-changed-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:52:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1f786ca8-8229-4d85-beba-1483a3f7040e req-186d14b6-d9ca-4c7e-b984-cf543d17b773 service nova] Acquiring lock "refresh_cache-5af7f4c7-5937-4b69-831e-941d7de4417d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1f786ca8-8229-4d85-beba-1483a3f7040e req-186d14b6-d9ca-4c7e-b984-cf543d17b773 service nova] Acquired lock "refresh_cache-5af7f4c7-5937-4b69-831e-941d7de4417d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:11 user nova-compute[72409]: DEBUG nova.network.neutron [req-1f786ca8-8229-4d85-beba-1483a3f7040e req-186d14b6-d9ca-4c7e-b984-cf543d17b773 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Refreshing network info cache for port 8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:52:11 user nova-compute[72409]: DEBUG nova.network.neutron [req-1f786ca8-8229-4d85-beba-1483a3f7040e req-186d14b6-d9ca-4c7e-b984-cf543d17b773 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Updated VIF entry in instance network info cache for port 8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:52:11 user nova-compute[72409]: DEBUG nova.network.neutron [req-1f786ca8-8229-4d85-beba-1483a3f7040e req-186d14b6-d9ca-4c7e-b984-cf543d17b773 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Updating instance_info_cache with network_info: [{"id": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "address": "fa:16:3e:92:55:4d", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eff036f-2f", "ovs_interfaceid": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1f786ca8-8229-4d85-beba-1483a3f7040e req-186d14b6-d9ca-4c7e-b984-cf543d17b773 service nova] Releasing lock "refresh_cache-5af7f4c7-5937-4b69-831e-941d7de4417d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Acquiring lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:12 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lazy-loading 'flavor' on Instance uuid bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Acquiring lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:13 user nova-compute[72409]: INFO nova.compute.manager [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Attaching volume 49428537-823c-4828-b16a-354e931cd4ef to /dev/vdb
Aug 09 22:52:13 user nova-compute[72409]: DEBUG os_brick.utils [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af3dd3f-6a71-4d41-8152-f7d2042bc761]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[431ce195-71f8-413d-bc8e-68d616efc38e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db9a174-744a-4c14-a990-dcf2265bbac5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d493e01-2458-4ffa-8752-0a1e4f41f9b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:13 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[52921f1e-95dc-4875-b730-5af39c7ccd76]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG os_brick.utils [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Updating existing volume attachment record: 9e395ba9-9ba1-457a-9be9-bee9c44d4fbd {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-ba236d11-f051-475e-bfcb-e3f638294426 req-b98216d1-edd2-41b9-8dfd-6bd7f3f28ace service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Received event network-changed-02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-ba236d11-f051-475e-bfcb-e3f638294426 req-b98216d1-edd2-41b9-8dfd-6bd7f3f28ace service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Refreshing instance network info cache due to event network-changed-02736d2f-5ea1-41ca-9570-8e14feb041b1. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ba236d11-f051-475e-bfcb-e3f638294426 req-b98216d1-edd2-41b9-8dfd-6bd7f3f28ace service nova] Acquiring lock "refresh_cache-bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ba236d11-f051-475e-bfcb-e3f638294426 req-b98216d1-edd2-41b9-8dfd-6bd7f3f28ace service nova] Acquired lock "refresh_cache-bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG nova.network.neutron [req-ba236d11-f051-475e-bfcb-e3f638294426 req-b98216d1-edd2-41b9-8dfd-6bd7f3f28ace service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Refreshing network info cache for port 02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG nova.network.neutron [req-ba236d11-f051-475e-bfcb-e3f638294426 req-b98216d1-edd2-41b9-8dfd-6bd7f3f28ace service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Updated VIF entry in instance network info cache for port 02736d2f-5ea1-41ca-9570-8e14feb041b1. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:52:13 user nova-compute[72409]: DEBUG nova.network.neutron [req-ba236d11-f051-475e-bfcb-e3f638294426 req-b98216d1-edd2-41b9-8dfd-6bd7f3f28ace service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Updating instance_info_cache with network_info: [{"id": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "address": "fa:16:3e:e0:3a:ad", "network": {"id": "4868dbae-2144-4a2a-aecb-fe9c4f0bc39a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-221632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b22450125f542bba84d7ca1254adc42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02736d2f-5e", "ovs_interfaceid": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ba236d11-f051-475e-bfcb-e3f638294426 req-b98216d1-edd2-41b9-8dfd-6bd7f3f28ace service nova] Releasing lock "refresh_cache-bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "5af7f4c7-5937-4b69-831e-941d7de4417d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG nova.objects.instance [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lazy-loading 'flavor' on Instance uuid 5af7f4c7-5937-4b69-831e-941d7de4417d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "5af7f4c7-5937-4b69-831e-941d7de4417d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:15 user nova-compute[72409]: INFO nova.compute.manager [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Attaching volume 0b8e7596-6dde-4782-b9aa-65b8d9355947 to /dev/vdb
Aug 09 22:52:15 user nova-compute[72409]: DEBUG os_brick.utils [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28ab867-8446-4593-a80a-2509322f9a27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0f22cd-baa6-4e16-bb02-669681b63420]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed338e8-860c-46f2-8c0f-9f7e1a8c1ef2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3f71e6-0e5d-4302-9f84-eb53e106169b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:15 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:52:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefdb0a5-744e-42c9-b904-7c354d81f567]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG os_brick.utils [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:15 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Updating existing volume attachment record: 57bb56b3-9ee3-47c5-9171-483f744a8d47 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:52:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:17 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621522.350996, 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:52:17 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] VM Stopped (Lifecycle Event)
Aug 09 22:52:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c6925448-97fb-4aab-b174-90bd68ed965b None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:52:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-8e7af64d-1b13-4f35-85e9-8816dd6369f4 req-006ab8d9-0438-4da2-93eb-c16abec9dd6d service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Received event network-changed-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-8e7af64d-1b13-4f35-85e9-8816dd6369f4 req-006ab8d9-0438-4da2-93eb-c16abec9dd6d service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Refreshing instance network info cache due to event network-changed-67bb13f5-76f3-4cc6-98c8-27caf4a1f140. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:52:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8e7af64d-1b13-4f35-85e9-8816dd6369f4 req-006ab8d9-0438-4da2-93eb-c16abec9dd6d service nova] Acquiring lock "refresh_cache-7b252875-ae91-4f8c-ae44-71097f9809a2" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8e7af64d-1b13-4f35-85e9-8816dd6369f4 req-006ab8d9-0438-4da2-93eb-c16abec9dd6d service nova] Acquired lock "refresh_cache-7b252875-ae91-4f8c-ae44-71097f9809a2" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:17 user nova-compute[72409]: DEBUG nova.network.neutron [req-8e7af64d-1b13-4f35-85e9-8816dd6369f4 req-006ab8d9-0438-4da2-93eb-c16abec9dd6d service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Refreshing network info cache for port 67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:52:18 user nova-compute[72409]: DEBUG nova.network.neutron [req-8e7af64d-1b13-4f35-85e9-8816dd6369f4 req-006ab8d9-0438-4da2-93eb-c16abec9dd6d service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Updated VIF entry in instance network info cache for port 67bb13f5-76f3-4cc6-98c8-27caf4a1f140. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:52:18 user nova-compute[72409]: DEBUG nova.network.neutron [req-8e7af64d-1b13-4f35-85e9-8816dd6369f4 req-006ab8d9-0438-4da2-93eb-c16abec9dd6d service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Updating instance_info_cache with network_info: [{"id": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "address": "fa:16:3e:8b:4b:f3", "network": {"id": "6a82d39a-e6ee-42ed-8588-8400f18cee5a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-617297362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df159d250877407ba2a1768c49ebefb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bb13f5-76", "ovs_interfaceid": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8e7af64d-1b13-4f35-85e9-8816dd6369f4 req-006ab8d9-0438-4da2-93eb-c16abec9dd6d service nova] Releasing lock "refresh_cache-7b252875-ae91-4f8c-ae44-71097f9809a2" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "7b252875-ae91-4f8c-ae44-71097f9809a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG nova.objects.instance [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lazy-loading 'flavor' on Instance uuid 7b252875-ae91-4f8c-ae44-71097f9809a2 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621527.658391, 9fce283c-f8da-4dd8-89be-64eba9d8486c => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:52:22 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] VM Stopped (Lifecycle Event)
Aug 09 22:52:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-fe24c77e-f8da-4756-bd0e-e0eb967785b1 None None] [instance: 9fce283c-f8da-4dd8-89be-64eba9d8486c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "7b252875-ae91-4f8c-ae44-71097f9809a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:22 user nova-compute[72409]: INFO nova.compute.manager [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Attaching volume a2258ec9-2039-463b-ba76-324fe585c48d to /dev/sdc
Aug 09 22:52:22 user nova-compute[72409]: DEBUG os_brick.utils [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a393e9-b9eb-47d4-be5d-9ab091cb3e61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b28ff05-5d15-4c4d-8650-399cd7eacdf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00b1fb6-2fc7-4157-b88e-bb7a0faa0b33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[782591dd-03c3-49f4-9824-089e660ec797]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:22 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:52:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfa4ad7-88ac-4eef-b277-dec37a1dd760]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG os_brick.utils [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:22 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Updating existing volume attachment record: 95a5ac9a-890b-4296-8044-cbc803d939cd {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:52:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAeGoKkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:25 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:25 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:25 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[397640b8-bd5e-4175-a7de-66f53ba36866]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:52:25 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5d50f0-f90c-445e-bad4-a5d606971185]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef] added
Aug 09 22:52:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a8ee7b-abef-4a0a-a125-32f7aab2fd78]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6322a00-73b7-4fb8-904a-51801cd8f4ed]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aAeGoKkg {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aAeGoKkg" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdc7689-2c79-4530-b3c8-0053574e7740]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aAeGoKkg'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8176eac7-154b-4de5-be64-178adaa2fb03]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf952e69-13a9-423d-bfd0-803a2e67cfe9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b251dc-ecd6-4300-94d5-66f43ff50608]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef, portal: 172.16.0.220,3260]
Aug 09 22:52:25 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef, portal: 172.16.0.220,3260] successful.
Aug 09 22:52:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a7f4d2-52b2-4140-a167-1a2adb83f7ab]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53908fd-0d14-4703-8661-206970feb93c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef (non-flash)
Aug 09 22:52:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:25 user nova-compute[72409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef (non-flash)
Aug 09 22:52:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[988343fe-14f9-496f-a305-7ee099210ec8]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAeGoKkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-0c7f5871-2b67-472d-9852-7685d21df964 req-015347c2-5ab2-47b4-a6b6-c8fb8200e2c9 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-changed-8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-0c7f5871-2b67-472d-9852-7685d21df964 req-015347c2-5ab2-47b4-a6b6-c8fb8200e2c9 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Refreshing instance network info cache due to event network-changed-8c4beea2-41b0-4bf4-be54-170aa75d060a. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0c7f5871-2b67-472d-9852-7685d21df964 req-015347c2-5ab2-47b4-a6b6-c8fb8200e2c9 service nova] Acquiring lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0c7f5871-2b67-472d-9852-7685d21df964 req-015347c2-5ab2-47b4-a6b6-c8fb8200e2c9 service nova] Acquired lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:25 user nova-compute[72409]: DEBUG nova.network.neutron [req-0c7f5871-2b67-472d-9852-7685d21df964 req-015347c2-5ab2-47b4-a6b6-c8fb8200e2c9 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Refreshing network info cache for port 8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "interface-7297de80-2674-4d9e-88e7-7a809bcf7381-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "interface-7297de80-2674-4d9e-88e7-7a809bcf7381-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG nova.objects.instance [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lazy-loading 'flavor' on Instance uuid 7297de80-2674-4d9e-88e7-7a809bcf7381 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG nova.network.neutron [req-0c7f5871-2b67-472d-9852-7685d21df964 req-015347c2-5ab2-47b4-a6b6-c8fb8200e2c9 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Updated VIF entry in instance network info cache for port 8c4beea2-41b0-4bf4-be54-170aa75d060a. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG nova.network.neutron [req-0c7f5871-2b67-472d-9852-7685d21df964 req-015347c2-5ab2-47b4-a6b6-c8fb8200e2c9 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Updating instance_info_cache with network_info: [{"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0c7f5871-2b67-472d-9852-7685d21df964 req-015347c2-5ab2-47b4-a6b6-c8fb8200e2c9 service nova] Releasing lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG nova.objects.instance [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lazy-loading 'pci_requests' on Instance uuid 7297de80-2674-4d9e-88e7-7a809bcf7381 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG nova.network.neutron [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23631376530363136', 'path': '/dev/sdf'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631376530363136', 'path': '/dev/sdf'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lazy-loading 'flavor' on Instance uuid bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG nova.policy [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25c4618cd6154fc6a3205d0b42f5a0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ab01b4b8ef44a3b303aca035f69503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:52:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] attach device xml: <disk type="block" device="disk">
Aug 09 22:52:26 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:26 user nova-compute[72409]:   <source dev="/dev/sdf"/>
Aug 09 22:52:26 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:52:26 user nova-compute[72409]:   <serial>49428537-823c-4828-b16a-354e931cd4ef</serial>
Aug 09 22:52:26 user nova-compute[72409]: </disk>
Aug 09 22:52:26 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] No VIF found with MAC fa:16:3e:e0:3a:ad, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bf689d2-ca95-4b7f-9712-1bc317897abf tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.157s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-e8649f41-de96-4e69-9abd-21b22a38bd98 req-d8f3d7da-0107-44d5-a901-636548259e29 service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received event network-changed-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-e8649f41-de96-4e69-9abd-21b22a38bd98 req-d8f3d7da-0107-44d5-a901-636548259e29 service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Refreshing instance network info cache due to event network-changed-47a0bdd7-ce8f-475f-a9a0-231959ed4ead. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e8649f41-de96-4e69-9abd-21b22a38bd98 req-d8f3d7da-0107-44d5-a901-636548259e29 service nova] Acquiring lock "refresh_cache-2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e8649f41-de96-4e69-9abd-21b22a38bd98 req-d8f3d7da-0107-44d5-a901-636548259e29 service nova] Acquired lock "refresh_cache-2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG nova.network.neutron [req-e8649f41-de96-4e69-9abd-21b22a38bd98 req-d8f3d7da-0107-44d5-a901-636548259e29 service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Refreshing network info cache for port 47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-78c83f94-5495-46f9-b586-7f968af35b03 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] volume_snapshot_create: create_info: {'snapshot_id': '34a67431-2136-4b8b-8c06-b03800a8cff1', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72409) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-78c83f94-5495-46f9-b586-7f968af35b03 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] snap xml: <domainsnapshot>
Aug 09 22:52:27 user nova-compute[72409]:   <disks>
Aug 09 22:52:27 user nova-compute[72409]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 09 22:52:27 user nova-compute[72409]:       <source file="/dev/new_file"/>
Aug 09 22:52:27 user nova-compute[72409]:     </disk>
Aug 09 22:52:27 user nova-compute[72409]:     <disk name="vda" snapshot="no"/>
Aug 09 22:52:27 user nova-compute[72409]:   </disks>
Aug 09 22:52:27 user nova-compute[72409]: </domainsnapshot>
Aug 09 22:52:27 user nova-compute[72409]:  {{(pid=72409) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG nova.objects.instance [None req-78c83f94-5495-46f9-b586-7f968af35b03 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lazy-loading 'system_metadata' on Instance uuid bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:27 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-78c83f94-5495-46f9-b586-7f968af35b03 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [None req-78c83f94-5495-46f9-b586-7f968af35b03 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Traceback (most recent call last):
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     rv = execute(f, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     six.reraise(c, e, tb)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     raise value
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     rv = meth(*args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] 
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [None req-78c83f94-5495-46f9-b586-7f968af35b03 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Traceback (most recent call last):
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     self._volume_snapshot_create(context, instance, guest,
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     rv = execute(f, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     six.reraise(c, e, tb)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     raise value
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     rv = meth(*args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] 
Aug 09 22:52:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-71d31ca1-245a-4e7e-9531-78345aecf61c tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] volume_snapshot_delete: delete_info: {'volume_id': '49428537-823c-4828-b16a-354e931cd4ef'} {{(pid=72409) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [None req-71d31ca1-245a-4e7e-9531-78345aecf61c tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Traceback (most recent call last):
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c]     if delete_info['type'] != 'qcow2':
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] KeyError: 'type'
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] 
Aug 09 22:52:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lazy-loading 'flavor' on Instance uuid 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [None req-78c83f94-5495-46f9-b586-7f968af35b03 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 34a67431-2136-4b8b-8c06-b03800a8cff1 could not be found.
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     raise value
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver 
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver 
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 34a67431-2136-4b8b-8c06-b03800a8cff1 could not be found. (HTTP 404) (Request-ID: req-c1861ac8-9b70-44bc-b07a-5c1b47956ab5)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver 
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver 
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 34a67431-2136-4b8b-8c06-b03800a8cff1 could not be found.
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver 
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server [None req-78c83f94-5495-46f9-b586-7f968af35b03 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     raise value
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server 
Aug 09 22:52:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Successfully created port: 1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:52:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver [None req-71d31ca1-245a-4e7e-9531-78345aecf61c tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver 
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver 
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-91d2950d-c747-4d70-b79e-ef92cfd78751)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver 
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver 
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 22:52:27 user nova-compute[72409]: ERROR nova.virt.libvirt.driver 
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server [None req-71d31ca1-245a-4e7e-9531-78345aecf61c tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Exception during message handling: KeyError: 'type'
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 09 22:52:27 user nova-compute[72409]: ERROR oslo_messaging.rpc.server 
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:28 user nova-compute[72409]: INFO nova.compute.manager [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Attaching volume 3725a632-aaa9-45b4-bc13-f872ea6ef99c to /dev/vdb
Aug 09 22:52:28 user nova-compute[72409]: DEBUG os_brick.utils [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Acquiring lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-e8649f41-de96-4e69-9abd-21b22a38bd98 req-d8f3d7da-0107-44d5-a901-636548259e29 service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Updated VIF entry in instance network info cache for port 47a0bdd7-ce8f-475f-a9a0-231959ed4ead. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-e8649f41-de96-4e69-9abd-21b22a38bd98 req-d8f3d7da-0107-44d5-a901-636548259e29 service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Updating instance_info_cache with network_info: [{"id": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "address": "fa:16:3e:d7:57:ed", "network": {"id": "9bc6437a-445d-4bd1-8fd5-56e4d64fc45e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1499918820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bd4aed4e4c43cb9e3096f4f3757776", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a0bdd7-ce", "ovs_interfaceid": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e613145-22bd-4eb0-9903-7f459fe171f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:28 user nova-compute[72409]: INFO nova.compute.manager [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Detaching volume 49428537-823c-4828-b16a-354e931cd4ef
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e8649f41-de96-4e69-9abd-21b22a38bd98 req-d8f3d7da-0107-44d5-a901-636548259e29 service nova] Releasing lock "refresh_cache-2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57d2187-7cfc-4c79-a190-37eddc8c27e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5bbacf-4c0f-4eaa-b202-aef2f5019e0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2fd38a-1902-4986-8d3c-e8c81602d2bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:28 user nova-compute[72409]: INFO nova.virt.block_device [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Attempting to driver detach volume 49428537-823c-4828-b16a-354e931cd4ef from mountpoint /dev/vdb
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Attempting to detach device vdb from instance bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 22:52:28 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:28 user nova-compute[72409]:   <source dev="/dev/sdf"/>
Aug 09 22:52:28 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:52:28 user nova-compute[72409]:   <serial>49428537-823c-4828-b16a-354e931cd4ef</serial>
Aug 09 22:52:28 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 22:52:28 user nova-compute[72409]: </disk>
Aug 09 22:52:28 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:28 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d01c16-a7ce-4787-afa1-43539248ffca]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG os_brick.utils [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Updating existing volume attachment record: 5f926293-adb9-414f-b850-d04bef9ce650 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:52:28 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Successfully detached device vdb from instance bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c from the persistent domain config.
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 22:52:28 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:28 user nova-compute[72409]:   <source dev="/dev/sdf"/>
Aug 09 22:52:28 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:52:28 user nova-compute[72409]:   <serial>49428537-823c-4828-b16a-354e931cd4ef</serial>
Aug 09 22:52:28 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 22:52:28 user nova-compute[72409]: </disk>
Aug 09 22:52:28 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.network.neutron [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Successfully updated port: 1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquired lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.network.neutron [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-1d2cd51b-f47c-4d9a-ad96-186a7e8d64c2 req-4feb6ea1-e81f-488f-af87-26bfab56d254 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-changed-1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-1d2cd51b-f47c-4d9a-ad96-186a7e8d64c2 req-4feb6ea1-e81f-488f-af87-26bfab56d254 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Refreshing instance network info cache due to event network-changed-1320e771-b1d9-439e-8d1d-7d0fe6553f7f. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1d2cd51b-f47c-4d9a-ad96-186a7e8d64c2 req-4feb6ea1-e81f-488f-af87-26bfab56d254 service nova] Acquiring lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691621548.9412599, bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 22:52:28 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Successfully detached device vdb from instance bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c from the live domain config.
Aug 09 22:52:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aAeGoKkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:28 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab5434e-eeae-451d-9b30-e249e9ac3527]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2ddfc6-a5ee-491c-94d9-3750b6514fba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:29 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:29 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:29 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:29 user nova-compute[72409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef (non-flash)
Aug 09 22:52:29 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:29 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:29 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:29 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:29 user nova-compute[72409]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef (non-flash)
Aug 09 22:52:29 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e943832e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef'): ({'sdf'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Removing single pathed devices sdf {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d23d7b3-0b22-42a0-aa87-1716301db2f8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e80823-d972-499d-9037-6ab4ef793367]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Flushing IO for device /dev/sdf {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c4b100-c22a-4b4a-8347-b67bb34346d2]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9018e45b-3f0b-4e0d-89d6-6c434afc2697]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] SCSI volumes sdf have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8444cb-86a5-4782-8b63-5e21dce33e2f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfafb78-a2a3-42bc-a96c-34a54a926400]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef, portal: 172.16.0.220,3260]
Aug 09 22:52:29 user nova-compute[72409]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef, portal: 172.16.0.220,3260] successful.
Aug 09 22:52:29 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49428537-823c-4828-b16a-354e931cd4ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[32235519-4137-4733-ac19-b698abe68390]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] <== disconnect_volume: return (298ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG nova.network.neutron [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Updating instance_info_cache with network_info: [{"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "address": "fa:16:3e:87:4e:50", "network": {"id": "a009d746-7b48-4c39-9f73-e9cf5f9d5cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2098496432", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1320e771-b1", "ovs_interfaceid": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Releasing lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1d2cd51b-f47c-4d9a-ad96-186a7e8d64c2 req-4feb6ea1-e81f-488f-af87-26bfab56d254 service nova] Acquired lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG nova.network.neutron [req-1d2cd51b-f47c-4d9a-ad96-186a7e8d64c2 req-4feb6ea1-e81f-488f-af87-26bfab56d254 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Refreshing network info cache for port 1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850058011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850058011',id=7,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRPOKUNKx5r99nfeKMhpfm/VZ7AykvwNHlx19s63HAGjMBCMer6PwKksiSdO/uCgcrPPCs4Mdvnww76K8FCrlZ8SSpOgbs2r8XIKgBv2t3yYVeYOMw4Yjg1wzdcpPxGXQ==',key_name='tempest-keypair-1164357353',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c5ab01b4b8ef44a3b303aca035f69503',ramdisk_id='',reservation_id='r-mufx0for',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-12735973',owner_user_name='tempest-TaggedAttachmentsTest-12735973-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c4618cd6154fc6a3205d0b42f5a0f4',uuid=7297de80-2674-4d9e-88e7-7a809bcf7381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "address": "fa:16:3e:87:4e:50", "network": {"id": "a009d746-7b48-4c39-9f73-e9cf5f9d5cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2098496432", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1320e771-b1", "ovs_interfaceid": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converting VIF {"id": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "address": "fa:16:3e:87:4e:50", "network": {"id": "a009d746-7b48-4c39-9f73-e9cf5f9d5cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2098496432", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1320e771-b1", "ovs_interfaceid": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:50,bridge_name='br-int',has_traffic_filtering=True,id=1320e771-b1d9-439e-8d1d-7d0fe6553f7f,network=Network(a009d746-7b48-4c39-9f73-e9cf5f9d5cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1320e771-b1') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG os_vif [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:50,bridge_name='br-int',has_traffic_filtering=True,id=1320e771-b1d9-439e-8d1d-7d0fe6553f7f,network=Network(a009d746-7b48-4c39-9f73-e9cf5f9d5cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1320e771-b1') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1320e771-b1, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1320e771-b1, col_values=(('external_ids', {'iface-id': '1320e771-b1d9-439e-8d1d-7d0fe6553f7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:4e:50', 'vm-uuid': '7297de80-2674-4d9e-88e7-7a809bcf7381'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:29 user nova-compute[72409]: INFO os_vif [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:50,bridge_name='br-int',has_traffic_filtering=True,id=1320e771-b1d9-439e-8d1d-7d0fe6553f7f,network=Network(a009d746-7b48-4c39-9f73-e9cf5f9d5cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1320e771-b1')
Aug 09 22:52:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850058011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850058011',id=7,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRPOKUNKx5r99nfeKMhpfm/VZ7AykvwNHlx19s63HAGjMBCMer6PwKksiSdO/uCgcrPPCs4Mdvnww76K8FCrlZ8SSpOgbs2r8XIKgBv2t3yYVeYOMw4Yjg1wzdcpPxGXQ==',key_name='tempest-keypair-1164357353',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c5ab01b4b8ef44a3b303aca035f69503',ramdisk_id='',reservation_id='r-mufx0for',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-12735973',owner_user_name='tempest-TaggedAttachmentsTest-12735973-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c4618cd6154fc6a3205d0b42f5a0f4',uuid=7297de80-2674-4d9e-88e7-7a809bcf7381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "address": "fa:16:3e:87:4e:50", "network": {"id": "a009d746-7b48-4c39-9f73-e9cf5f9d5cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2098496432", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1320e771-b1", "ovs_interfaceid": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converting VIF {"id": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "address": "fa:16:3e:87:4e:50", "network": {"id": "a009d746-7b48-4c39-9f73-e9cf5f9d5cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2098496432", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1320e771-b1", "ovs_interfaceid": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:50,bridge_name='br-int',has_traffic_filtering=True,id=1320e771-b1d9-439e-8d1d-7d0fe6553f7f,network=Network(a009d746-7b48-4c39-9f73-e9cf5f9d5cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1320e771-b1') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] attach device xml: <interface type="ethernet">
Aug 09 22:52:29 user nova-compute[72409]:   <mac address="fa:16:3e:87:4e:50"/>
Aug 09 22:52:29 user nova-compute[72409]:   <model type="virtio"/>
Aug 09 22:52:29 user nova-compute[72409]:   <mtu size="1442"/>
Aug 09 22:52:29 user nova-compute[72409]:   <target dev="tap1320e771-b1"/>
Aug 09 22:52:29 user nova-compute[72409]: </interface>
Aug 09 22:52:29 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] No BDM found with device name hda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] No VIF found with MAC fa:16:3e:1b:38:d8, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:52:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:52:30 user nova-compute[72409]:   <nova:package version="0.0.0"/>
Aug 09 22:52:30 user nova-compute[72409]:   <nova:name>tempest-device-tagging-server-850058011</nova:name>
Aug 09 22:52:30 user nova-compute[72409]:   <nova:creationTime>2023-08-09 22:52:30</nova:creationTime>
Aug 09 22:52:30 user nova-compute[72409]:   <nova:flavor name="m1.tiny">
Aug 09 22:52:30 user nova-compute[72409]:     <nova:memory>512</nova:memory>
Aug 09 22:52:30 user nova-compute[72409]:     <nova:disk>1</nova:disk>
Aug 09 22:52:30 user nova-compute[72409]:     <nova:swap>0</nova:swap>
Aug 09 22:52:30 user nova-compute[72409]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:52:30 user nova-compute[72409]:     <nova:vcpus>1</nova:vcpus>
Aug 09 22:52:30 user nova-compute[72409]:   </nova:flavor>
Aug 09 22:52:30 user nova-compute[72409]:   <nova:owner>
Aug 09 22:52:30 user nova-compute[72409]:     <nova:user uuid="25c4618cd6154fc6a3205d0b42f5a0f4">tempest-TaggedAttachmentsTest-12735973-project-member</nova:user>
Aug 09 22:52:30 user nova-compute[72409]:     <nova:project uuid="c5ab01b4b8ef44a3b303aca035f69503">tempest-TaggedAttachmentsTest-12735973</nova:project>
Aug 09 22:52:30 user nova-compute[72409]:   </nova:owner>
Aug 09 22:52:30 user nova-compute[72409]:   <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:52:30 user nova-compute[72409]:   <nova:ports>
Aug 09 22:52:30 user nova-compute[72409]:     <nova:port uuid="8c4beea2-41b0-4bf4-be54-170aa75d060a">
Aug 09 22:52:30 user nova-compute[72409]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 22:52:30 user nova-compute[72409]:     </nova:port>
Aug 09 22:52:30 user nova-compute[72409]:     <nova:port uuid="1320e771-b1d9-439e-8d1d-7d0fe6553f7f">
Aug 09 22:52:30 user nova-compute[72409]:       <nova:ip type="fixed" address="10.10.10.178" ipVersion="4"/>
Aug 09 22:52:30 user nova-compute[72409]:     </nova:port>
Aug 09 22:52:30 user nova-compute[72409]:   </nova:ports>
Aug 09 22:52:30 user nova-compute[72409]: </nova:instance>
Aug 09 22:52:30 user nova-compute[72409]:  {{(pid=72409) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 22:52:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6d9faa6d-9f4c-4a74-9152-bee04e8277d4 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "interface-7297de80-2674-4d9e-88e7-7a809bcf7381-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.951s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-1d2cd51b-f47c-4d9a-ad96-186a7e8d64c2 req-4feb6ea1-e81f-488f-af87-26bfab56d254 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Updated VIF entry in instance network info cache for port 1320e771-b1d9-439e-8d1d-7d0fe6553f7f. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:52:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-1d2cd51b-f47c-4d9a-ad96-186a7e8d64c2 req-4feb6ea1-e81f-488f-af87-26bfab56d254 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Updating instance_info_cache with network_info: [{"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "address": "fa:16:3e:87:4e:50", "network": {"id": "a009d746-7b48-4c39-9f73-e9cf5f9d5cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2098496432", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1320e771-b1", "ovs_interfaceid": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1d2cd51b-f47c-4d9a-ad96-186a7e8d64c2 req-4feb6ea1-e81f-488f-af87-26bfab56d254 service nova] Releasing lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-0ff33f73-d7c7-41a8-93af-6a805aa2ab71 req-a83a487f-3acc-405f-bf00-a04cf5481355 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-vif-plugged-1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0ff33f73-d7c7-41a8-93af-6a805aa2ab71 req-a83a487f-3acc-405f-bf00-a04cf5481355 service nova] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0ff33f73-d7c7-41a8-93af-6a805aa2ab71 req-a83a487f-3acc-405f-bf00-a04cf5481355 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0ff33f73-d7c7-41a8-93af-6a805aa2ab71 req-a83a487f-3acc-405f-bf00-a04cf5481355 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-0ff33f73-d7c7-41a8-93af-6a805aa2ab71 req-a83a487f-3acc-405f-bf00-a04cf5481355 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] No waiting events found dispatching network-vif-plugged-1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:31 user nova-compute[72409]: WARNING nova.compute.manager [req-0ff33f73-d7c7-41a8-93af-6a805aa2ab71 req-a83a487f-3acc-405f-bf00-a04cf5481355 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received unexpected event network-vif-plugged-1320e771-b1d9-439e-8d1d-7d0fe6553f7f for instance with vm_state active and task_state None.
Aug 09 22:52:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-0ff33f73-d7c7-41a8-93af-6a805aa2ab71 req-a83a487f-3acc-405f-bf00-a04cf5481355 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-vif-plugged-1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0ff33f73-d7c7-41a8-93af-6a805aa2ab71 req-a83a487f-3acc-405f-bf00-a04cf5481355 service nova] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0ff33f73-d7c7-41a8-93af-6a805aa2ab71 req-a83a487f-3acc-405f-bf00-a04cf5481355 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0ff33f73-d7c7-41a8-93af-6a805aa2ab71 req-a83a487f-3acc-405f-bf00-a04cf5481355 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-0ff33f73-d7c7-41a8-93af-6a805aa2ab71 req-a83a487f-3acc-405f-bf00-a04cf5481355 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] No waiting events found dispatching network-vif-plugged-1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:31 user nova-compute[72409]: WARNING nova.compute.manager [req-0ff33f73-d7c7-41a8-93af-6a805aa2ab71 req-a83a487f-3acc-405f-bf00-a04cf5481355 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received unexpected event network-vif-plugged-1320e771-b1d9-439e-8d1d-7d0fe6553f7f for instance with vm_state active and task_state None.
Aug 09 22:52:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:52:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCsUFcyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:31 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:32 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:32 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2609e149-21da-4a5e-b4bd-5b9212616248]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:52:32 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad021ca8-e1fa-4106-ba5c-3a5f490a8359]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947] added
Aug 09 22:52:32 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7143eb2e-4d44-4a2d-b6d1-c44879d5c1bf]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a03d9af-dfb2-49e8-97b6-f318902d1526]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MCsUFcyo {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MCsUFcyo" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[21316271-bcde-433d-b014-102bbd7212e8]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MCsUFcyo'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b98b99-726d-414f-aeed-0a8ab6d4dd56]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eddca0-daeb-4915-9022-8f71d0098a3f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:32 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:32 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7775117c-e409-42ad-bc8d-9cffc0a0a712]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947, portal: 172.16.0.220,3260]
Aug 09 22:52:32 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947, portal: 172.16.0.220,3260] successful.
Aug 09 22:52:32 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f66225-2ac9-46e3-80a6-cfa58a47567d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4207bf-ee24-4e6b-85ad-bf918359fd48]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)
Aug 09 22:52:32 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:32 user nova-compute[72409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)
Aug 09 22:52:32 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[057735f1-8b89-4f4d-934d-96935b405994]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCsUFcyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLCEhugk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:32 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG nova.objects.instance [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lazy-loading 'flavor' on Instance uuid 7297de80-2674-4d9e-88e7-7a809bcf7381 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:33 user nova-compute[72409]: INFO nova.compute.manager [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Attaching volume 4956deb4-8970-430d-9b01-057d79563126 to /dev/vdb
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23966323962633466', 'path': '/dev/sdf'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966323962633466', 'path': '/dev/sdf'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.588s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:33 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:33 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG nova.objects.instance [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lazy-loading 'flavor' on Instance uuid 5af7f4c7-5937-4b69-831e-941d7de4417d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[320f38a6-320a-4f3e-b51c-e22a751dc524]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:52:33 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 22:52:33 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:33 user nova-compute[72409]:   <source dev="/dev/sdf"/>
Aug 09 22:52:33 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:52:33 user nova-compute[72409]:   <serial>0b8e7596-6dde-4782-b9aa-65b8d9355947</serial>
Aug 09 22:52:33 user nova-compute[72409]: </disk>
Aug 09 22:52:33 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[989c4380-a07e-42da-b1d7-069975870e01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d] added
Aug 09 22:52:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbe6e29-dd20-442b-b881-557a151e408e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[47da7b48-7d67-4716-99a5-f9cae19a7a57]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLCEhugk {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.utils [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLCEhugk" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff9ab22-e3c3-493d-ad79-302cf051726d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jLCEhugk'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca4b729-cc73-46bf-a6a5-8f0f02b68746]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61b4fca-4fdd-41ca-a306-1d037dbb4296]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c58a9c7-3051-44af-b4fa-0a28f448c43c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db1dfba-253a-4789-a22f-b71b5a78e64d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)
Aug 09 22:52:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)
Aug 09 22:52:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7171da53-ef6d-4ef4-9a5a-19035af41ca4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd30a06-4173-4d89-b563-69fc7ba2146a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:33 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d44bb1-0d9a-45c4-9023-e1281dbec0ab]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[996d64cf-08ab-47e3-8daf-7c7c406ecac4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.utils [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Updating existing volume attachment record: 9671e4c6-69ee-499f-a86b-6db3d10f9681 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d, portal: 172.16.0.220,3260]
Aug 09 22:52:33 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d, portal: 172.16.0.220,3260] successful.
Aug 09 22:52:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3733ef-b84e-48fb-8962-1561aca2fbc8]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0981da4d-2a80-424d-8ec2-af82df2836cd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)
Aug 09 22:52:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)
Aug 09 22:52:33 user nova-compute[72409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)
Aug 09 22:52:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf19592-1c4f-4a59-93f3-f01aed385eff]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLCEhugk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] No VIF found with MAC fa:16:3e:92:55:4d, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:52:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] <== connect_volume: return (1971ms) {'type': 'block', 'scsi_wwn': '26164623936366231', 'path': '/dev/sdg'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164623936366231', 'path': '/dev/sdg'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:52:34 user nova-compute[72409]: DEBUG nova.objects.instance [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lazy-loading 'flavor' on Instance uuid 7b252875-ae91-4f8c-ae44-71097f9809a2 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 22:52:34 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:34 user nova-compute[72409]:   <source dev="/dev/sdg"/>
Aug 09 22:52:34 user nova-compute[72409]:   <target dev="sdc" bus="scsi"/>
Aug 09 22:52:34 user nova-compute[72409]:   <serial>a2258ec9-2039-463b-ba76-324fe585c48d</serial>
Aug 09 22:52:34 user nova-compute[72409]:   <address type="drive" controller="0" unit="2"/>
Aug 09 22:52:34 user nova-compute[72409]: </disk>
Aug 09 22:52:34 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 22:52:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] No BDM found with device name sda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] No VIF found with MAC fa:16:3e:8b:4b:f3, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:52:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG nova.objects.instance [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lazy-loading 'flavor' on Instance uuid bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6d995125-ed25-4a69-9cd9-a04aaab6f885 tempest-VolumesAssistedSnapshotsTest-142289087 tempest-VolumesAssistedSnapshotsTest-142289087-project-admin] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 13.777s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e51b2ecb-a19f-49b7-8f9c-4bd71c7bb63a tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.761s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahjEBkbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:42 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:42 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:42 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc157727-c34e-42c8-94c1-a285a525f4ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:52:42 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da2080d-5129-4f09-bdb8-5b7766ff41e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c] added
Aug 09 22:52:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[955b52c1-1f09-48fb-ac97-6b509865b74f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf087607-c36a-4b2a-bbb2-0b433ef3888b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahjEBkbO {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6152132d-da7a-48ab-b940-1ee4e6340c9e tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.689s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-b23bd0b8-8d37-4cc9-8a09-24108a2fdc6c req-b6d5430f-03f7-433a-8b92-52b42cfd3829 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event network-changed-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-b23bd0b8-8d37-4cc9-8a09-24108a2fdc6c req-b6d5430f-03f7-433a-8b92-52b42cfd3829 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Refreshing instance network info cache due to event network-changed-c37915d3-63af-47d7-8618-adee0e79e4ce. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b23bd0b8-8d37-4cc9-8a09-24108a2fdc6c req-b6d5430f-03f7-433a-8b92-52b42cfd3829 service nova] Acquiring lock "refresh_cache-29a04807-1c46-4546-b78c-73d4f2b86c46" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b23bd0b8-8d37-4cc9-8a09-24108a2fdc6c req-b6d5430f-03f7-433a-8b92-52b42cfd3829 service nova] Acquired lock "refresh_cache-29a04807-1c46-4546-b78c-73d4f2b86c46" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG nova.network.neutron [req-b23bd0b8-8d37-4cc9-8a09-24108a2fdc6c req-b6d5430f-03f7-433a-8b92-52b42cfd3829 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Refreshing network info cache for port c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahjEBkbO" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be51835-e7e5-4e72-9420-03be7127b006]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ahjEBkbO'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8e431a-fa0e-4560-8445-f69fcdaf9883]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc92050-dda4-44e3-bd28-49033aef5bf4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)
Aug 09 22:52:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)
Aug 09 22:52:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[189cc0e6-ba2d-4809-95e0-3dc0c85bbfac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260]
Aug 09 22:52:42 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260] successful.
Aug 09 22:52:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abb514f-f9c9-4814-b926-baf0d7fdc0eb]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e68872-fbfc-464d-a794-e1351f527dba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)
Aug 09 22:52:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)
Aug 09 22:52:42 user nova-compute[72409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)
Aug 09 22:52:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[49035028-d4de-42e4-bb25-be48f46e0f87]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:52:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahjEBkbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.network.neutron [req-b23bd0b8-8d37-4cc9-8a09-24108a2fdc6c req-b6d5430f-03f7-433a-8b92-52b42cfd3829 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Updated VIF entry in instance network info cache for port c37915d3-63af-47d7-8618-adee0e79e4ce. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.network.neutron [req-b23bd0b8-8d37-4cc9-8a09-24108a2fdc6c req-b6d5430f-03f7-433a-8b92-52b42cfd3829 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Updating instance_info_cache with network_info: [{"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b23bd0b8-8d37-4cc9-8a09-24108a2fdc6c req-b6d5430f-03f7-433a-8b92-52b42cfd3829 service nova] Releasing lock "refresh_cache-29a04807-1c46-4546-b78c-73d4f2b86c46" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "5af7f4c7-5937-4b69-831e-941d7de4417d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:43 user nova-compute[72409]: INFO nova.compute.manager [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Detaching volume 0b8e7596-6dde-4782-b9aa-65b8d9355947
Aug 09 22:52:43 user nova-compute[72409]: INFO nova.virt.block_device [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Attempting to driver detach volume 0b8e7596-6dde-4782-b9aa-65b8d9355947 from mountpoint /dev/vdb
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Attempting to detach device vdb from instance 5af7f4c7-5937-4b69-831e-941d7de4417d from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 22:52:43 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:43 user nova-compute[72409]:   <source dev="/dev/sdf"/>
Aug 09 22:52:43 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:52:43 user nova-compute[72409]:   <serial>0b8e7596-6dde-4782-b9aa-65b8d9355947</serial>
Aug 09 22:52:43 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 22:52:43 user nova-compute[72409]: </disk>
Aug 09 22:52:43 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:52:43 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Successfully detached device vdb from instance 5af7f4c7-5937-4b69-831e-941d7de4417d from the persistent domain config.
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5af7f4c7-5937-4b69-831e-941d7de4417d from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 22:52:43 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:43 user nova-compute[72409]:   <source dev="/dev/sdf"/>
Aug 09 22:52:43 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:52:43 user nova-compute[72409]:   <serial>0b8e7596-6dde-4782-b9aa-65b8d9355947</serial>
Aug 09 22:52:43 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 22:52:43 user nova-compute[72409]: </disk>
Aug 09 22:52:43 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:52:43 user nova-compute[72409]: INFO nova.compute.manager [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Rebuilding instance
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.objects.instance [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lazy-loading 'trusted_certs' on Instance uuid 29a04807-1c46-4546-b78c-73d4f2b86c46 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23862613430656166', 'path': '/dev/sdh'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862613430656166', 'path': '/dev/sdh'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.compute.manager [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lazy-loading 'flavor' on Instance uuid 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 22:52:43 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:43 user nova-compute[72409]:   <source dev="/dev/sdh"/>
Aug 09 22:52:43 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:52:43 user nova-compute[72409]:   <serial>3725a632-aaa9-45b4-bc13-f872ea6ef99c</serial>
Aug 09 22:52:43 user nova-compute[72409]: </disk>
Aug 09 22:52:43 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691621563.8169088, 5af7f4c7-5937-4b69-831e-941d7de4417d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.objects.instance [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lazy-loading 'pci_requests' on Instance uuid 29a04807-1c46-4546-b78c-73d4f2b86c46 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5af7f4c7-5937-4b69-831e-941d7de4417d {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 22:52:43 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Successfully detached device vdb from instance 5af7f4c7-5937-4b69-831e-941d7de4417d from the live domain config.
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MCsUFcyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:43 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.objects.instance [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lazy-loading 'pci_devices' on Instance uuid 29a04807-1c46-4546-b78c-73d4f2b86c46 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.objects.instance [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lazy-loading 'resources' on Instance uuid 29a04807-1c46-4546-b78c-73d4f2b86c46 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[259f15c7-bc9a-43d9-9909-a622d3db60fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.objects.instance [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lazy-loading 'migration_context' on Instance uuid 29a04807-1c46-4546-b78c-73d4f2b86c46 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG nova.objects.instance [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72409) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[722a359a-f824-457b-a683-d971d987ad4a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:43 user nova-compute[72409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:43 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:43 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:43 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:43 user nova-compute[72409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)
Aug 09 22:52:43 user nova-compute[72409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)
Aug 09 22:52:43 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:43 user nova-compute[72409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:43 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:43 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:43 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:43 user nova-compute[72409]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 (non-flash)
Aug 09 22:52:43 user nova-compute[72409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)
Aug 09 22:52:43 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84542440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947'): ({'sdf'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Removing single pathed devices sdf {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "7b252875-ae91-4f8c-ae44-71097f9809a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ddac9b-dfe5-47fe-9172-fe9401b7b8f2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:43 user nova-compute[72409]: INFO nova.compute.manager [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Detaching volume a2258ec9-2039-463b-ba76-324fe585c48d
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e95611e-aaa2-4574-85b6-e179023a5ae3]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Flushing IO for device /dev/sdf {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c01c657-cde8-4df3-b97f-7db71074c6d0]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:52:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c138355-28e6-4d60-9805-34bf7810e262]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] SCSI volumes sdf have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:52:44 user nova-compute[72409]: INFO nova.virt.block_device [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Attempting to driver detach volume a2258ec9-2039-463b-ba76-324fe585c48d from mountpoint /dev/sdc
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Attempting to detach device sdc from instance 7b252875-ae91-4f8c-ae44-71097f9809a2 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 22:52:44 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:44 user nova-compute[72409]:   <source dev="/dev/sdg"/>
Aug 09 22:52:44 user nova-compute[72409]:   <target dev="sdc" bus="scsi"/>
Aug 09 22:52:44 user nova-compute[72409]:   <serial>a2258ec9-2039-463b-ba76-324fe585c48d</serial>
Aug 09 22:52:44 user nova-compute[72409]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 22:52:44 user nova-compute[72409]: </disk>
Aug 09 22:52:44 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[135d3084-a9b2-4025-aab4-811304e5030a]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Successfully detached device sdc from instance 7b252875-ae91-4f8c-ae44-71097f9809a2 from the persistent domain config.
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 7b252875-ae91-4f8c-ae44-71097f9809a2 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 22:52:44 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:44 user nova-compute[72409]:   <source dev="/dev/sdg"/>
Aug 09 22:52:44 user nova-compute[72409]:   <target dev="sdc" bus="scsi"/>
Aug 09 22:52:44 user nova-compute[72409]:   <serial>a2258ec9-2039-463b-ba76-324fe585c48d</serial>
Aug 09 22:52:44 user nova-compute[72409]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 22:52:44 user nova-compute[72409]: </disk>
Aug 09 22:52:44 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[20caa157-8c64-4f44-92b3-61f1a293efa3]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947, portal: 172.16.0.220,3260]
Aug 09 22:52:44 user nova-compute[72409]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947, portal: 172.16.0.220,3260] successful.
Aug 09 22:52:44 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b8e7596-6dde-4782-b9aa-65b8d9355947 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31d2b27-d3bc-4f2b-89cb-0ee78a07def2]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] <== disconnect_volume: return (358ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-23a84b0f-f545-4ffb-af2b-225f9239d5fb req-04653380-4fb9-41a7-a210-084e4a15707a service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event network-vif-unplugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-23a84b0f-f545-4ffb-af2b-225f9239d5fb req-04653380-4fb9-41a7-a210-084e4a15707a service nova] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-23a84b0f-f545-4ffb-af2b-225f9239d5fb req-04653380-4fb9-41a7-a210-084e4a15707a service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-23a84b0f-f545-4ffb-af2b-225f9239d5fb req-04653380-4fb9-41a7-a210-084e4a15707a service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-23a84b0f-f545-4ffb-af2b-225f9239d5fb req-04653380-4fb9-41a7-a210-084e4a15707a service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] No waiting events found dispatching network-vif-unplugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:44 user nova-compute[72409]: WARNING nova.compute.manager [req-23a84b0f-f545-4ffb-af2b-225f9239d5fb req-04653380-4fb9-41a7-a210-084e4a15707a service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received unexpected event network-vif-unplugged-c37915d3-63af-47d7-8618-adee0e79e4ce for instance with vm_state active and task_state rebuilding.
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] No VIF found with MAC fa:16:3e:d7:57:ed, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a7fa8d9d-3f48-4684-9500-53305072f39b tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.301s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691621564.5316634, 7b252875-ae91-4f8c-ae44-71097f9809a2 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 7b252875-ae91-4f8c-ae44-71097f9809a2 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 22:52:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Successfully detached device sdc from instance 7b252875-ae91-4f8c-ae44-71097f9809a2 from the live domain config.
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLCEhugk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:44 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fb887c-ee45-46a8-9e58-8597a40ad1c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3e0168-7ccd-4a8f-8d8c-c531121de3b8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:44 user nova-compute[72409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:44 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:44 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:44 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:44 user nova-compute[72409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)
Aug 09 22:52:44 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:44 user nova-compute[72409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:44 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:44 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:44 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:44 user nova-compute[72409]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d (non-flash)
Aug 09 22:52:44 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e943afeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d'): ({'sdg'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Removing single pathed devices sdg {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c881eaae-f10d-4e03-9712-e1fe19ab6817]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aec4a3-9118-4394-9c02-f68e8f8569c6]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Flushing IO for device /dev/sdg {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2e1b47-f189-4c87-b37a-62be6304381d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.067s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63f50d6-83d6-4c3e-995a-3e13706cb603]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] SCSI volumes sdg have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4564172-edff-47fc-93b2-9ec4cab7a585]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b98b26-26fd-4a87-a110-a4446ef30c9a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d, portal: 172.16.0.220,3260]
Aug 09 22:52:44 user nova-compute[72409]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d, portal: 172.16.0.220,3260] successful.
Aug 09 22:52:44 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2258ec9-2039-463b-ba76-324fe585c48d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc415c45-6ce6-40ae-8da2-8f6cb4634855]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] <== disconnect_volume: return (328ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:52:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Instance destroyed successfully.
Aug 09 22:52:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Instance destroyed successfully.
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-632707458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1227232666',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAoSaQCdVvuh57WXjFA13EBow7aKBmqRgJwb6HwSpyFB+eussplICF19CzXtR/xzCNYd09zaCo7OZWi2arzQlCx/TWpdlW31VSARWFAbCK5rWCe0CK613+EMVVBpM3mvg==',key_name='tempest-keypair-1505891920',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:51:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='501f4894d8ce46d08a02baf924d7e51e',ramdisk_id='',reservation_id='r-6hu0v00n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1870090794',owner_user_name='tempest-ServerActionsV293TestJSON-1870090794-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:52:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be4e91cf0054f548ea7a1d75426b72b',uuid=29a04807-1c46-4546-b78c-73d4f2b86c46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Converting VIF {"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_vif [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc37915d3-63, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:44 user nova-compute[72409]: INFO os_vif [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63')
Aug 09 22:52:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSJapLlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:44 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a96358-eddc-4ebc-a9e1-ca558aed5ef4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6eecd1-5d0b-469f-b10a-f6b37c2fccb3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:45 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:45 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84543eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[39608221-1c26-4322-a25e-45600d413fac]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7132fdb0-85f5-47ad-b771-f45e64ddea89]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74c6c43-a781-4c2e-815a-7e38a45b0291]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bcac9f-0a32-400a-a08e-1f6c561ef365]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed17d566-329b-4e16-b5f0-0fd6a6554785]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG nova.objects.instance [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lazy-loading 'flavor' on Instance uuid 5af7f4c7-5937-4b69-831e-941d7de4417d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70d280a-504f-49a2-9ad9-4f9f107e01fe]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260]
Aug 09 22:52:45 user nova-compute[72409]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260] successful.
Aug 09 22:52:45 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.245s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4df475b-4c50-495b-804c-c3be6f41820e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.521s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] <== disconnect_volume: return (522ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:52:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Deleting instance files /opt/stack/data/nova/instances/29a04807-1c46-4546-b78c-73d4f2b86c46_del
Aug 09 22:52:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Deletion of /opt/stack/data/nova/instances/29a04807-1c46-4546-b78c-73d4f2b86c46_del complete
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f8da9ec4-be07-477d-aa83-a955ce8c1f26 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.255s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.utils [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8025a7fa-df31-40de-80c6-a107a92cc535]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2003a9f8-37ed-467a-9f54-f3fe6d3fd573]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 29a04807-1c46-4546-b78c-73d4f2b86c46 could not be found.
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSJapLlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:45 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc4fcf8-abf6-4bd9-8058-c66f479b1004]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80b8382-c00f-401c-ac84-5e0386e20ea5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7e1bf7-98f2-4b58-831e-82746483ec71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:45 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[000bf6a4-0292-43df-8766-0b3a8d4fe9ae]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.utils [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62933d5-69c9-4c4d-802e-b47fa48e7995]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:45 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:45 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:45 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e9c131120>, {}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Disconnecting from: [] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] <== disconnect_volume: return (92ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:52:46 user nova-compute[72409]: DEBUG nova.objects.instance [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lazy-loading 'flavor' on Instance uuid 7b252875-ae91-4f8c-ae44-71097f9809a2 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:46 user nova-compute[72409]: INFO nova.compute.manager [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Swapping volume 3725a632-aaa9-45b4-bc13-f872ea6ef99c for 5634271d-4590-407f-a584-24202129b233
Aug 09 22:52:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e929ce36-befd-4a28-823a-e62048bc7c78 tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.127s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-426c2f1b-ddb1-467f-a36f-b6280a3a42cf req-48092273-33ee-4d69-943c-4750ac1146dd service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-426c2f1b-ddb1-467f-a36f-b6280a3a42cf req-48092273-33ee-4d69-943c-4750ac1146dd service nova] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-426c2f1b-ddb1-467f-a36f-b6280a3a42cf req-48092273-33ee-4d69-943c-4750ac1146dd service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-426c2f1b-ddb1-467f-a36f-b6280a3a42cf req-48092273-33ee-4d69-943c-4750ac1146dd service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-426c2f1b-ddb1-467f-a36f-b6280a3a42cf req-48092273-33ee-4d69-943c-4750ac1146dd service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] No waiting events found dispatching network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:46 user nova-compute[72409]: WARNING nova.compute.manager [req-426c2f1b-ddb1-467f-a36f-b6280a3a42cf req-48092273-33ee-4d69-943c-4750ac1146dd service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received unexpected event network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce for instance with vm_state active and task_state rebuilding.
Aug 09 22:52:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Preparing to wait for external event volume-reimaged-531786d5-d1a0-48d4-9074-1d5dd0797145 {{(pid=72409) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 09 22:52:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "7b252875-ae91-4f8c-ae44-71097f9809a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:47 user nova-compute[72409]: INFO nova.compute.manager [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Terminating instance
Aug 09 22:52:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG nova.compute.manager [req-16604d49-8a3e-4467-9963-dc0fa5586261 req-315c4800-b227-49e2-9afc-ee2f301e7b70 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Received event network-vif-unplugged-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-16604d49-8a3e-4467-9963-dc0fa5586261 req-315c4800-b227-49e2-9afc-ee2f301e7b70 service nova] Acquiring lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-16604d49-8a3e-4467-9963-dc0fa5586261 req-315c4800-b227-49e2-9afc-ee2f301e7b70 service nova] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-16604d49-8a3e-4467-9963-dc0fa5586261 req-315c4800-b227-49e2-9afc-ee2f301e7b70 service nova] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG nova.compute.manager [req-16604d49-8a3e-4467-9963-dc0fa5586261 req-315c4800-b227-49e2-9afc-ee2f301e7b70 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] No waiting events found dispatching network-vif-unplugged-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:47 user nova-compute[72409]: DEBUG nova.compute.manager [req-16604d49-8a3e-4467-9963-dc0fa5586261 req-315c4800-b227-49e2-9afc-ee2f301e7b70 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Received event network-vif-unplugged-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:48 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Instance destroyed successfully.
Aug 09 22:52:48 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lazy-loading 'resources' on Instance uuid 7b252875-ae91-4f8c-ae44-71097f9809a2 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1735458139',display_name='tempest-AttachSCSIVolumeTestJSON-server-1735458139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1735458139',id=6,image_ref='ef322503-42d9-4dbd-94fe-2f41a6f608ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPG0+2NT+f/U0hWtxChf3P2unNM+gLutfYMAYfreX/5EuDllcH2h9Zxbq32l4Sw+9dtuGa4+AGppOxPefDi3LUA20DOlpELoFrmOwsPYjmggpMvPHr3hAwgb0Qi+N3ZaA==',key_name='tempest-keypair-126976649',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df159d250877407ba2a1768c49ebefb0',ramdisk_id='',reservation_id='r-1vda10hg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ef322503-42d9-4dbd-94fe-2f41a6f608ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-9083404',owner_user_name='tempest-AttachSCSIVolumeTestJSON-9083404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:50:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fbc4c06b52f4db98f7b9e4b2843a52c',uuid=7b252875-ae91-4f8c-ae44-71097f9809a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "address": "fa:16:3e:8b:4b:f3", "network": {"id": "6a82d39a-e6ee-42ed-8588-8400f18cee5a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-617297362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df159d250877407ba2a1768c49ebefb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bb13f5-76", "ovs_interfaceid": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Converting VIF {"id": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "address": "fa:16:3e:8b:4b:f3", "network": {"id": "6a82d39a-e6ee-42ed-8588-8400f18cee5a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-617297362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df159d250877407ba2a1768c49ebefb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67bb13f5-76", "ovs_interfaceid": "67bb13f5-76f3-4cc6-98c8-27caf4a1f140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:4b:f3,bridge_name='br-int',has_traffic_filtering=True,id=67bb13f5-76f3-4cc6-98c8-27caf4a1f140,network=Network(6a82d39a-e6ee-42ed-8588-8400f18cee5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bb13f5-76') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_vif [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:4b:f3,bridge_name='br-int',has_traffic_filtering=True,id=67bb13f5-76f3-4cc6-98c8-27caf4a1f140,network=Network(6a82d39a-e6ee-42ed-8588-8400f18cee5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bb13f5-76') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67bb13f5-76, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:52:48 user nova-compute[72409]: INFO os_vif [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:4b:f3,bridge_name='br-int',has_traffic_filtering=True,id=67bb13f5-76f3-4cc6-98c8-27caf4a1f140,network=Network(6a82d39a-e6ee-42ed-8588-8400f18cee5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67bb13f5-76')
Aug 09 22:52:48 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Deleting instance files /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2_del
Aug 09 22:52:48 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Deletion of /opt/stack/data/nova/instances/7b252875-ae91-4f8c-ae44-71097f9809a2_del complete
Aug 09 22:52:48 user nova-compute[72409]: INFO nova.compute.manager [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTDUsKSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:48 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:48 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:48 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cb8023-0913-45a9-a27a-f919735f99b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:52:48 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6304fccb-a0dc-4de7-886e-529ea2f0f37c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126] added
Aug 09 22:52:48 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9425cc9e-f3d4-4e07-916c-078b351a62bb]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b234e742-b96d-481c-a5df-912acfd564d6]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTDUsKSh {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTDUsKSh" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fb7a16-9f55-4b1a-bb3f-305edd3e95b5]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aTDUsKSh'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6282c1f2-553f-4f04-b1b2-1fec62004680]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ff595b-def9-4cfc-a16e-71e93fe7a2f5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:48 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:48 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:48 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:48 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:48 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:48 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:48 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:48 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f0a248-cc7a-498f-9129-229ec81618e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126, portal: 172.16.0.220,3260]
Aug 09 22:52:49 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126, portal: 172.16.0.220,3260] successful.
Aug 09 22:52:49 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf6c8d1-431b-4fdd-80fa-692d970f40c0]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc541e0-206b-41a0-b41d-b2316a8e204a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:49 user nova-compute[72409]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 (non-flash)
Aug 09 22:52:49 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:49 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:49 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:49 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:49 user nova-compute[72409]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 (non-flash)
Aug 09 22:52:49 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:49 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:49 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:49 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2400c29-3a53-46b3-9e16-247149d0bf23]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTDUsKSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:49 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Took 1.00 seconds to deallocate network for instance.
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-4a33c630-9b14-4c98-8e81-3d6980788334 req-43d4ac52-e238-4a9f-98e7-eaa08ef58c0c service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Received event network-vif-deleted-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Acquiring lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Acquiring lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:49 user nova-compute[72409]: INFO nova.compute.manager [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Terminating instance
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:49 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Deleted allocations for instance 7b252875-ae91-4f8c-ae44-71097f9809a2
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-2013e21c-9718-49fd-adb9-268e807f855e req-88b1c476-d47b-4896-99fb-ebf468004187 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Received event network-vif-plugged-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2013e21c-9718-49fd-adb9-268e807f855e req-88b1c476-d47b-4896-99fb-ebf468004187 service nova] Acquiring lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2013e21c-9718-49fd-adb9-268e807f855e req-88b1c476-d47b-4896-99fb-ebf468004187 service nova] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2013e21c-9718-49fd-adb9-268e807f855e req-88b1c476-d47b-4896-99fb-ebf468004187 service nova] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-2013e21c-9718-49fd-adb9-268e807f855e req-88b1c476-d47b-4896-99fb-ebf468004187 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] No waiting events found dispatching network-vif-plugged-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:49 user nova-compute[72409]: WARNING nova.compute.manager [req-2013e21c-9718-49fd-adb9-268e807f855e req-88b1c476-d47b-4896-99fb-ebf468004187 service nova] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Received unexpected event network-vif-plugged-67bb13f5-76f3-4cc6-98c8-27caf4a1f140 for instance with vm_state deleted and task_state None.
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1e7f014f-9b66-49d7-98db-29e21161e1fd tempest-AttachSCSIVolumeTestJSON-9083404 tempest-AttachSCSIVolumeTestJSON-9083404-project-member] Lock "7b252875-ae91-4f8c-ae44-71097f9809a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.510s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 09 22:52:49 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Instance destroyed successfully.
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.objects.instance [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lazy-loading 'resources' on Instance uuid 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1421648356',display_name='tempest-VolumesActionsTest-instance-1421648356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1421648356',id=8,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2c901cd7c354ef3995541c399ad6b53',ramdisk_id='',reservation_id='r-wr5v70y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-42932609',owner_user_name='tempest-VolumesActionsTest-42932609-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:50:48Z,user_data=None,user_id='e9c4bf079af74145823bf7023dc03e86',uuid=202694e3-a5ae-48b9-bfa4-0eac9f27f5dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "address": "fa:16:3e:0d:f1:45", "network": {"id": "02696fba-3297-48c9-a6ec-6189eff28116", "bridge": "br-int", "label": "tempest-VolumesActionsTest-930483453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2c901cd7c354ef3995541c399ad6b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec2ec10-3c", "ovs_interfaceid": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Converting VIF {"id": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "address": "fa:16:3e:0d:f1:45", "network": {"id": "02696fba-3297-48c9-a6ec-6189eff28116", "bridge": "br-int", "label": "tempest-VolumesActionsTest-930483453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2c901cd7c354ef3995541c399ad6b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ec2ec10-3c", "ovs_interfaceid": "3ec2ec10-3c80-4262-888a-95dac8c6b172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:45,bridge_name='br-int',has_traffic_filtering=True,id=3ec2ec10-3c80-4262-888a-95dac8c6b172,network=Network(02696fba-3297-48c9-a6ec-6189eff28116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec2ec10-3c') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG os_vif [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:45,bridge_name='br-int',has_traffic_filtering=True,id=3ec2ec10-3c80-4262-888a-95dac8c6b172,network=Network(02696fba-3297-48c9-a6ec-6189eff28116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec2ec10-3c') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ec2ec10-3c, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:49 user nova-compute[72409]: INFO os_vif [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:45,bridge_name='br-int',has_traffic_filtering=True,id=3ec2ec10-3c80-4262-888a-95dac8c6b172,network=Network(02696fba-3297-48c9-a6ec-6189eff28116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ec2ec10-3c')
Aug 09 22:52:49 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Deleting instance files /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd_del
Aug 09 22:52:50 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Deletion of /opt/stack/data/nova/instances/202694e3-a5ae-48b9-bfa4-0eac9f27f5dd_del complete
Aug 09 22:52:50 user nova-compute[72409]: INFO nova.compute.manager [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 09 22:52:50 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-5af7f4c7-5937-4b69-831e-941d7de4417d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-5af7f4c7-5937-4b69-831e-941d7de4417d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23636643666343465', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636643666343465', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG nova.objects.instance [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lazy-loading 'flavor' on Instance uuid 7297de80-2674-4d9e-88e7-7a809bcf7381 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 22:52:50 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:50 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 22:52:50 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:52:50 user nova-compute[72409]:   <serial>4956deb4-8970-430d-9b01-057d79563126</serial>
Aug 09 22:52:50 user nova-compute[72409]: </disk>
Aug 09 22:52:50 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] No BDM found with device name hda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] No VIF found with MAC fa:16:3e:1b:38:d8, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:52:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-92de4d90-cf16-4f62-8811-712b9b3f2741 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.650s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Updating instance_info_cache with network_info: [{"id": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "address": "fa:16:3e:92:55:4d", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eff036f-2f", "ovs_interfaceid": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:51 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Took 1.32 seconds to deallocate network for instance.
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-5af7f4c7-5937-4b69-831e-941d7de4417d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-93d9932e-a410-441b-8af7-bb24dc3c1ee3 req-67ed2525-c0bf-4770-b54b-c41827d10613 service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Received event network-vif-deleted-3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-f214b817-d712-4960-86e6-7f97f9921349 req-6d2b914c-0a4c-4da7-b8ad-7ae09f890d9d service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Received event network-vif-unplugged-3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f214b817-d712-4960-86e6-7f97f9921349 req-6d2b914c-0a4c-4da7-b8ad-7ae09f890d9d service nova] Acquiring lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f214b817-d712-4960-86e6-7f97f9921349 req-6d2b914c-0a4c-4da7-b8ad-7ae09f890d9d service nova] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f214b817-d712-4960-86e6-7f97f9921349 req-6d2b914c-0a4c-4da7-b8ad-7ae09f890d9d service nova] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-f214b817-d712-4960-86e6-7f97f9921349 req-6d2b914c-0a4c-4da7-b8ad-7ae09f890d9d service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] No waiting events found dispatching network-vif-unplugged-3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:51 user nova-compute[72409]: WARNING nova.compute.manager [req-f214b817-d712-4960-86e6-7f97f9921349 req-6d2b914c-0a4c-4da7-b8ad-7ae09f890d9d service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Received unexpected event network-vif-unplugged-3ec2ec10-3c80-4262-888a-95dac8c6b172 for instance with vm_state deleted and task_state None.
Aug 09 22:52:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-f214b817-d712-4960-86e6-7f97f9921349 req-6d2b914c-0a4c-4da7-b8ad-7ae09f890d9d service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Received event network-vif-plugged-3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f214b817-d712-4960-86e6-7f97f9921349 req-6d2b914c-0a4c-4da7-b8ad-7ae09f890d9d service nova] Acquiring lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f214b817-d712-4960-86e6-7f97f9921349 req-6d2b914c-0a4c-4da7-b8ad-7ae09f890d9d service nova] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f214b817-d712-4960-86e6-7f97f9921349 req-6d2b914c-0a4c-4da7-b8ad-7ae09f890d9d service nova] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-f214b817-d712-4960-86e6-7f97f9921349 req-6d2b914c-0a4c-4da7-b8ad-7ae09f890d9d service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] No waiting events found dispatching network-vif-plugged-3ec2ec10-3c80-4262-888a-95dac8c6b172 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:51 user nova-compute[72409]: WARNING nova.compute.manager [req-f214b817-d712-4960-86e6-7f97f9921349 req-6d2b914c-0a4c-4da7-b8ad-7ae09f890d9d service nova] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Received unexpected event network-vif-plugged-3ec2ec10-3c80-4262-888a-95dac8c6b172 for instance with vm_state deleted and task_state None.
Aug 09 22:52:51 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:51 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Deleted allocations for instance 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-698f5858-1d22-4781-8a0f-3f39a2eba536 tempest-VolumesActionsTest-42932609 tempest-VolumesActionsTest-42932609-project-member] Lock "202694e3-a5ae-48b9-bfa4-0eac9f27f5dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.627s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:52 user nova-compute[72409]: INFO nova.compute.manager [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Detaching volume 4956deb4-8970-430d-9b01-057d79563126
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "e203577d-fa3b-4494-ad4e-7e65ad88b387" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "e203577d-fa3b-4494-ad4e-7e65ad88b387" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:52 user nova-compute[72409]: INFO nova.virt.block_device [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Attempting to driver detach volume 4956deb4-8970-430d-9b01-057d79563126 from mountpoint /dev/vdb
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Attempting to detach device vdb from instance 7297de80-2674-4d9e-88e7-7a809bcf7381 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 22:52:52 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:52 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 22:52:52 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:52:52 user nova-compute[72409]:   <serial>4956deb4-8970-430d-9b01-057d79563126</serial>
Aug 09 22:52:52 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 22:52:52 user nova-compute[72409]: </disk>
Aug 09 22:52:52 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:52 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Successfully detached device vdb from instance 7297de80-2674-4d9e-88e7-7a809bcf7381 from the persistent domain config.
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7297de80-2674-4d9e-88e7-7a809bcf7381 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 22:52:52 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:52:52 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 22:52:52 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:52:52 user nova-compute[72409]:   <serial>4956deb4-8970-430d-9b01-057d79563126</serial>
Aug 09 22:52:52 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 22:52:52 user nova-compute[72409]: </disk>
Aug 09 22:52:52 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:52:52 user nova-compute[72409]: INFO nova.compute.claims [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Claim successful on node user
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691621572.733588, 7297de80-2674-4d9e-88e7-7a809bcf7381 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7297de80-2674-4d9e-88e7-7a809bcf7381 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 22:52:52 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Successfully detached device vdb from instance 7297de80-2674-4d9e-88e7-7a809bcf7381 from the live domain config.
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTDUsKSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:52 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab00c631-fade-4d95-b1c8-308b4552b9b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[be90674a-3d1a-48c6-9320-ed3066926cc8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:52 user nova-compute[72409]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 (non-flash)
Aug 09 22:52:52 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:52 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:52 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:52 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:52:52 user nova-compute[72409]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 (non-flash)
Aug 09 22:52:52 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:52:52 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:52:52 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:52:52 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e94396830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f18cad-79c6-4b72-8a36-f2d0a597b5fb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.network.neutron [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:52 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b308a5-0e63-479b-ac76-45dc7922d482]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d774f509-ed13-4345-a890-d3ef9357df2c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:52 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[edea3bae-a64f-4ecc-b892-c781ec6b1800]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:52:53 user nova-compute[72409]: INFO nova.virt.block_device [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Booting with blank volume at /dev/vda
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG nova.policy [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bf771a74e994703bd1ed49add72cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dfbbb5a1d134adba458e9c592f6fada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06aaa92-3276-4008-a9c8-8587424e590f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aca0ec-b47b-445e-99b0-47cc47e5b079]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126, portal: 172.16.0.220,3260]
Aug 09 22:52:53 user nova-compute[72409]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126, portal: 172.16.0.220,3260] successful.
Aug 09 22:52:53 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4956deb4-8970-430d-9b01-057d79563126 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d6cf95-e700-4322-901f-3f2d0e0bc560]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] <== disconnect_volume: return (397ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.network.neutron [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Successfully created port: 6e4259ce-19e2-42bc-bd8d-b9e189f58336 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:52:54 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:52:54 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7806MB free_disk=25.703624725341797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5af7f4c7-5937-4b69-831e-941d7de4417d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7297de80-2674-4d9e-88e7-7a809bcf7381 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 29a04807-1c46-4546-b78c-73d4f2b86c46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 162c9bef-7efd-480c-b49f-64c4c8f2616d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance e203577d-fa3b-4494-ad4e-7e65ad88b387 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Successfully updated port: 6e4259ce-19e2-42bc-bd8d-b9e189f58336 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "refresh_cache-e203577d-fa3b-4494-ad4e-7e65ad88b387" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquired lock "refresh_cache-e203577d-fa3b-4494-ad4e-7e65ad88b387" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-e39239df-d519-4ff6-b0f9-c459a3e6d847 req-6edc9a89-36ca-4667-a470-085867c44263 service nova] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Received event network-changed-6e4259ce-19e2-42bc-bd8d-b9e189f58336 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-e39239df-d519-4ff6-b0f9-c459a3e6d847 req-6edc9a89-36ca-4667-a470-085867c44263 service nova] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Refreshing instance network info cache due to event network-changed-6e4259ce-19e2-42bc-bd8d-b9e189f58336. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e39239df-d519-4ff6-b0f9-c459a3e6d847 req-6edc9a89-36ca-4667-a470-085867c44263 service nova] Acquiring lock "refresh_cache-e203577d-fa3b-4494-ad4e-7e65ad88b387" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Updating instance_info_cache with network_info: [{"id": "6e4259ce-19e2-42bc-bd8d-b9e189f58336", "address": "fa:16:3e:44:83:09", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4259ce-19", "ovs_interfaceid": "6e4259ce-19e2-42bc-bd8d-b9e189f58336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Releasing lock "refresh_cache-e203577d-fa3b-4494-ad4e-7e65ad88b387" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Instance network_info: |[{"id": "6e4259ce-19e2-42bc-bd8d-b9e189f58336", "address": "fa:16:3e:44:83:09", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4259ce-19", "ovs_interfaceid": "6e4259ce-19e2-42bc-bd8d-b9e189f58336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e39239df-d519-4ff6-b0f9-c459a3e6d847 req-6edc9a89-36ca-4667-a470-085867c44263 service nova] Acquired lock "refresh_cache-e203577d-fa3b-4494-ad4e-7e65ad88b387" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:52:55 user nova-compute[72409]: DEBUG nova.network.neutron [req-e39239df-d519-4ff6-b0f9-c459a3e6d847 req-6edc9a89-36ca-4667-a470-085867c44263 service nova] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Refreshing network info cache for port 6e4259ce-19e2-42bc-bd8d-b9e189f58336 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:52:56 user nova-compute[72409]: DEBUG nova.network.neutron [req-e39239df-d519-4ff6-b0f9-c459a3e6d847 req-6edc9a89-36ca-4667-a470-085867c44263 service nova] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Updated VIF entry in instance network info cache for port 6e4259ce-19e2-42bc-bd8d-b9e189f58336. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:52:56 user nova-compute[72409]: DEBUG nova.network.neutron [req-e39239df-d519-4ff6-b0f9-c459a3e6d847 req-6edc9a89-36ca-4667-a470-085867c44263 service nova] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Updating instance_info_cache with network_info: [{"id": "6e4259ce-19e2-42bc-bd8d-b9e189f58336", "address": "fa:16:3e:44:83:09", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4259ce-19", "ovs_interfaceid": "6e4259ce-19e2-42bc-bd8d-b9e189f58336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:52:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e39239df-d519-4ff6-b0f9-c459a3e6d847 req-6edc9a89-36ca-4667-a470-085867c44263 service nova] Releasing lock "refresh_cache-e203577d-fa3b-4494-ad4e-7e65ad88b387" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:52:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:57 user nova-compute[72409]: DEBUG nova.objects.instance [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lazy-loading 'flavor' on Instance uuid 7297de80-2674-4d9e-88e7-7a809bcf7381 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-fd462a40-5670-4bfc-9e85-5427504e49b5 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.604s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "interface-7297de80-2674-4d9e-88e7-7a809bcf7381-1320e771-b1d9-439e-8d1d-7d0fe6553f7f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "interface-7297de80-2674-4d9e-88e7-7a809bcf7381-1320e771-b1d9-439e-8d1d-7d0fe6553f7f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG nova.objects.instance [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lazy-loading 'flavor' on Instance uuid 7297de80-2674-4d9e-88e7-7a809bcf7381 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850058011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850058011',id=7,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRPOKUNKx5r99nfeKMhpfm/VZ7AykvwNHlx19s63HAGjMBCMer6PwKksiSdO/uCgcrPPCs4Mdvnww76K8FCrlZ8SSpOgbs2r8XIKgBv2t3yYVeYOMw4Yjg1wzdcpPxGXQ==',key_name='tempest-keypair-1164357353',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5ab01b4b8ef44a3b303aca035f69503',ramdisk_id='',reservation_id='r-mufx0for',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-12735973',owner_user_name='tempest-TaggedAttachmentsTest-12735973-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c4618cd6154fc6a3205d0b42f5a0f4',uuid=7297de80-2674-4d9e-88e7-7a809bcf7381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "address": "fa:16:3e:87:4e:50", "network": {"id": "a009d746-7b48-4c39-9f73-e9cf5f9d5cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2098496432", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1320e771-b1", "ovs_interfaceid": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converting VIF {"id": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "address": "fa:16:3e:87:4e:50", "network": {"id": "a009d746-7b48-4c39-9f73-e9cf5f9d5cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2098496432", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1320e771-b1", "ovs_interfaceid": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:50,bridge_name='br-int',has_traffic_filtering=True,id=1320e771-b1d9-439e-8d1d-7d0fe6553f7f,network=Network(a009d746-7b48-4c39-9f73-e9cf5f9d5cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1320e771-b1') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:4e:50"/><model type="virtio"/><mtu size="1442"/><target dev="tap1320e771-b1"/></interface> {{(pid=72409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:4e:50"/><model type="virtio"/><mtu size="1442"/><target dev="tap1320e771-b1"/></interface> {{(pid=72409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Attempting to detach device tap1320e771-b1 from instance 7297de80-2674-4d9e-88e7-7a809bcf7381 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] detach device xml: <interface type="ethernet">
Aug 09 22:52:58 user nova-compute[72409]:   <mac address="fa:16:3e:87:4e:50"/>
Aug 09 22:52:58 user nova-compute[72409]:   <model type="virtio"/>
Aug 09 22:52:58 user nova-compute[72409]:   <mtu size="1442"/>
Aug 09 22:52:58 user nova-compute[72409]:   <target dev="tap1320e771-b1"/>
Aug 09 22:52:58 user nova-compute[72409]: </interface>
Aug 09 22:52:58 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:4e:50"/><model type="virtio"/><mtu size="1442"/><target dev="tap1320e771-b1"/></interface> {{(pid=72409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:87:4e:50"/><model type="virtio"/><mtu size="1442"/><target dev="tap1320e771-b1"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 09 22:52:58 user nova-compute[72409]:   <name>instance-00000007</name>
Aug 09 22:52:58 user nova-compute[72409]:   <uuid>7297de80-2674-4d9e-88e7-7a809bcf7381</uuid>
Aug 09 22:52:58 user nova-compute[72409]:   <metadata>
Aug 09 22:52:58 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:52:58 user nova-compute[72409]:   <nova:package version="0.0.0"/>
Aug 09 22:52:58 user nova-compute[72409]:   <nova:name>tempest-device-tagging-server-850058011</nova:name>
Aug 09 22:52:58 user nova-compute[72409]:   <nova:creationTime>2023-08-09 22:52:30</nova:creationTime>
Aug 09 22:52:58 user nova-compute[72409]:   <nova:flavor name="m1.tiny">
Aug 09 22:52:58 user nova-compute[72409]:     <nova:memory>512</nova:memory>
Aug 09 22:52:58 user nova-compute[72409]:     <nova:disk>1</nova:disk>
Aug 09 22:52:58 user nova-compute[72409]:     <nova:swap>0</nova:swap>
Aug 09 22:52:58 user nova-compute[72409]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:52:58 user nova-compute[72409]:     <nova:vcpus>1</nova:vcpus>
Aug 09 22:52:58 user nova-compute[72409]:   </nova:flavor>
Aug 09 22:52:58 user nova-compute[72409]:   <nova:owner>
Aug 09 22:52:58 user nova-compute[72409]:     <nova:user uuid="25c4618cd6154fc6a3205d0b42f5a0f4">tempest-TaggedAttachmentsTest-12735973-project-member</nova:user>
Aug 09 22:52:58 user nova-compute[72409]:     <nova:project uuid="c5ab01b4b8ef44a3b303aca035f69503">tempest-TaggedAttachmentsTest-12735973</nova:project>
Aug 09 22:52:58 user nova-compute[72409]:   </nova:owner>
Aug 09 22:52:58 user nova-compute[72409]:   <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:52:58 user nova-compute[72409]:   <nova:ports>
Aug 09 22:52:58 user nova-compute[72409]:     <nova:port uuid="8c4beea2-41b0-4bf4-be54-170aa75d060a">
Aug 09 22:52:58 user nova-compute[72409]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 22:52:58 user nova-compute[72409]:     </nova:port>
Aug 09 22:52:58 user nova-compute[72409]:     <nova:port uuid="1320e771-b1d9-439e-8d1d-7d0fe6553f7f">
Aug 09 22:52:58 user nova-compute[72409]:       <nova:ip type="fixed" address="10.10.10.178" ipVersion="4"/>
Aug 09 22:52:58 user nova-compute[72409]:     </nova:port>
Aug 09 22:52:58 user nova-compute[72409]:   </nova:ports>
Aug 09 22:52:58 user nova-compute[72409]: </nova:instance>
Aug 09 22:52:58 user nova-compute[72409]:   </metadata>
Aug 09 22:52:58 user nova-compute[72409]:   <memory unit='KiB'>524288</memory>
Aug 09 22:52:58 user nova-compute[72409]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 22:52:58 user nova-compute[72409]:   <vcpu placement='static'>1</vcpu>
Aug 09 22:52:58 user nova-compute[72409]:   <resource>
Aug 09 22:52:58 user nova-compute[72409]:     <partition>/machine</partition>
Aug 09 22:52:58 user nova-compute[72409]:   </resource>
Aug 09 22:52:58 user nova-compute[72409]:   <sysinfo type='smbios'>
Aug 09 22:52:58 user nova-compute[72409]:     <system>
Aug 09 22:52:58 user nova-compute[72409]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 22:52:58 user nova-compute[72409]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 22:52:58 user nova-compute[72409]:       <entry name='version'>0.0.0</entry>
Aug 09 22:52:58 user nova-compute[72409]:       <entry name='serial'>7297de80-2674-4d9e-88e7-7a809bcf7381</entry>
Aug 09 22:52:58 user nova-compute[72409]:       <entry name='uuid'>7297de80-2674-4d9e-88e7-7a809bcf7381</entry>
Aug 09 22:52:58 user nova-compute[72409]:       <entry name='family'>Virtual Machine</entry>
Aug 09 22:52:58 user nova-compute[72409]:     </system>
Aug 09 22:52:58 user nova-compute[72409]:   </sysinfo>
Aug 09 22:52:58 user nova-compute[72409]:   <os>
Aug 09 22:52:58 user nova-compute[72409]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 22:52:58 user nova-compute[72409]:     <boot dev='hd'/>
Aug 09 22:52:58 user nova-compute[72409]:     <smbios mode='sysinfo'/>
Aug 09 22:52:58 user nova-compute[72409]:   </os>
Aug 09 22:52:58 user nova-compute[72409]:   <features>
Aug 09 22:52:58 user nova-compute[72409]:     <acpi/>
Aug 09 22:52:58 user nova-compute[72409]:     <apic/>
Aug 09 22:52:58 user nova-compute[72409]:     <vmcoreinfo state='on'/>
Aug 09 22:52:58 user nova-compute[72409]:   </features>
Aug 09 22:52:58 user nova-compute[72409]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 22:52:58 user nova-compute[72409]:     <model fallback='forbid'>Nehalem</model>
Aug 09 22:52:58 user nova-compute[72409]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 22:52:58 user nova-compute[72409]:     <feature policy='require' name='vme'/>
Aug 09 22:52:58 user nova-compute[72409]:     <feature policy='require' name='x2apic'/>
Aug 09 22:52:58 user nova-compute[72409]:     <feature policy='require' name='hypervisor'/>
Aug 09 22:52:58 user nova-compute[72409]:   </cpu>
Aug 09 22:52:58 user nova-compute[72409]:   <clock offset='utc'>
Aug 09 22:52:58 user nova-compute[72409]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 22:52:58 user nova-compute[72409]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 22:52:58 user nova-compute[72409]:     <timer name='hpet' present='no'/>
Aug 09 22:52:58 user nova-compute[72409]:   </clock>
Aug 09 22:52:58 user nova-compute[72409]:   <on_poweroff>destroy</on_poweroff>
Aug 09 22:52:58 user nova-compute[72409]:   <on_reboot>restart</on_reboot>
Aug 09 22:52:58 user nova-compute[72409]:   <on_crash>destroy</on_crash>
Aug 09 22:52:58 user nova-compute[72409]:   <devices>
Aug 09 22:52:58 user nova-compute[72409]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 22:52:58 user nova-compute[72409]:     <disk type='file' device='disk'>
Aug 09 22:52:58 user nova-compute[72409]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 22:52:58 user nova-compute[72409]:       <source file='/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk' index='2'/>
Aug 09 22:52:58 user nova-compute[72409]:       <backingStore type='file' index='3'>
Aug 09 22:52:58 user nova-compute[72409]:         <format type='raw'/>
Aug 09 22:52:58 user nova-compute[72409]:         <source file='/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e'/>
Aug 09 22:52:58 user nova-compute[72409]:         <backingStore/>
Aug 09 22:52:58 user nova-compute[72409]:       </backingStore>
Aug 09 22:52:58 user nova-compute[72409]:       <target dev='vda' bus='virtio'/>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='virtio-disk0'/>
Aug 09 22:52:58 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 22:52:58 user nova-compute[72409]:     </disk>
Aug 09 22:52:58 user nova-compute[72409]:     <disk type='file' device='cdrom'>
Aug 09 22:52:58 user nova-compute[72409]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 22:52:58 user nova-compute[72409]:       <source file='/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk.config' index='1'/>
Aug 09 22:52:58 user nova-compute[72409]:       <backingStore/>
Aug 09 22:52:58 user nova-compute[72409]:       <target dev='hda' bus='ide'/>
Aug 09 22:52:58 user nova-compute[72409]:       <readonly/>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='ide0-0-0'/>
Aug 09 22:52:58 user nova-compute[72409]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 22:52:58 user nova-compute[72409]:     </disk>
Aug 09 22:52:58 user nova-compute[72409]:     <controller type='usb' index='0' model='none'>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='usb'/>
Aug 09 22:52:58 user nova-compute[72409]:     </controller>
Aug 09 22:52:58 user nova-compute[72409]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='pci.0'/>
Aug 09 22:52:58 user nova-compute[72409]:     </controller>
Aug 09 22:52:58 user nova-compute[72409]:     <controller type='ide' index='0'>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='ide'/>
Aug 09 22:52:58 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 22:52:58 user nova-compute[72409]:     </controller>
Aug 09 22:52:58 user nova-compute[72409]:     <interface type='ethernet'>
Aug 09 22:52:58 user nova-compute[72409]:       <mac address='fa:16:3e:1b:38:d8'/>
Aug 09 22:52:58 user nova-compute[72409]:       <target dev='tap8c4beea2-41'/>
Aug 09 22:52:58 user nova-compute[72409]:       <model type='virtio'/>
Aug 09 22:52:58 user nova-compute[72409]:       <mtu size='1442'/>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='net0'/>
Aug 09 22:52:58 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 22:52:58 user nova-compute[72409]:     </interface>
Aug 09 22:52:58 user nova-compute[72409]:     <interface type='ethernet'>
Aug 09 22:52:58 user nova-compute[72409]:       <mac address='fa:16:3e:87:4e:50'/>
Aug 09 22:52:58 user nova-compute[72409]:       <target dev='tap1320e771-b1'/>
Aug 09 22:52:58 user nova-compute[72409]:       <model type='virtio'/>
Aug 09 22:52:58 user nova-compute[72409]:       <mtu size='1442'/>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='net1'/>
Aug 09 22:52:58 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 09 22:52:58 user nova-compute[72409]:     </interface>
Aug 09 22:52:58 user nova-compute[72409]:     <serial type='pty'>
Aug 09 22:52:58 user nova-compute[72409]:       <source path='/dev/pts/6'/>
Aug 09 22:52:58 user nova-compute[72409]:       <log file='/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/console.log' append='off'/>
Aug 09 22:52:58 user nova-compute[72409]:       <target type='isa-serial' port='0'>
Aug 09 22:52:58 user nova-compute[72409]:         <model name='isa-serial'/>
Aug 09 22:52:58 user nova-compute[72409]:       </target>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='serial0'/>
Aug 09 22:52:58 user nova-compute[72409]:     </serial>
Aug 09 22:52:58 user nova-compute[72409]:     <console type='pty' tty='/dev/pts/6'>
Aug 09 22:52:58 user nova-compute[72409]:       <source path='/dev/pts/6'/>
Aug 09 22:52:58 user nova-compute[72409]:       <log file='/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/console.log' append='off'/>
Aug 09 22:52:58 user nova-compute[72409]:       <target type='serial' port='0'/>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='serial0'/>
Aug 09 22:52:58 user nova-compute[72409]:     </console>
Aug 09 22:52:58 user nova-compute[72409]:     <input type='mouse' bus='ps2'>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='input0'/>
Aug 09 22:52:58 user nova-compute[72409]:     </input>
Aug 09 22:52:58 user nova-compute[72409]:     <input type='keyboard' bus='ps2'>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='input1'/>
Aug 09 22:52:58 user nova-compute[72409]:     </input>
Aug 09 22:52:58 user nova-compute[72409]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 09 22:52:58 user nova-compute[72409]:       <listen type='address' address='0.0.0.0'/>
Aug 09 22:52:58 user nova-compute[72409]:     </graphics>
Aug 09 22:52:58 user nova-compute[72409]:     <audio id='1' type='none'/>
Aug 09 22:52:58 user nova-compute[72409]:     <video>
Aug 09 22:52:58 user nova-compute[72409]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='video0'/>
Aug 09 22:52:58 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 22:52:58 user nova-compute[72409]:     </video>
Aug 09 22:52:58 user nova-compute[72409]:     <memballoon model='virtio'>
Aug 09 22:52:58 user nova-compute[72409]:       <stats period='10'/>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='balloon0'/>
Aug 09 22:52:58 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 22:52:58 user nova-compute[72409]:     </memballoon>
Aug 09 22:52:58 user nova-compute[72409]:     <rng model='virtio'>
Aug 09 22:52:58 user nova-compute[72409]:       <backend model='random'>/dev/urandom</backend>
Aug 09 22:52:58 user nova-compute[72409]:       <alias name='rng0'/>
Aug 09 22:52:58 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 22:52:58 user nova-compute[72409]:     </rng>
Aug 09 22:52:58 user nova-compute[72409]:   </devices>
Aug 09 22:52:58 user nova-compute[72409]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 22:52:58 user nova-compute[72409]:     <label>libvirt-7297de80-2674-4d9e-88e7-7a809bcf7381</label>
Aug 09 22:52:58 user nova-compute[72409]:     <imagelabel>libvirt-7297de80-2674-4d9e-88e7-7a809bcf7381</imagelabel>
Aug 09 22:52:58 user nova-compute[72409]:   </seclabel>
Aug 09 22:52:58 user nova-compute[72409]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 22:52:58 user nova-compute[72409]:     <label>+64055:+108</label>
Aug 09 22:52:58 user nova-compute[72409]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 22:52:58 user nova-compute[72409]:   </seclabel>
Aug 09 22:52:58 user nova-compute[72409]: </domain>
Aug 09 22:52:58 user nova-compute[72409]:  {{(pid=72409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 22:52:58 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Successfully detached device tap1320e771-b1 from instance 7297de80-2674-4d9e-88e7-7a809bcf7381 from the persistent domain config.
Aug 09 22:52:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] (1/8): Attempting to detach device tap1320e771-b1 with device alias net1 from instance 7297de80-2674-4d9e-88e7-7a809bcf7381 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 22:52:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] detach device xml: <interface type="ethernet">
Aug 09 22:52:58 user nova-compute[72409]:   <mac address="fa:16:3e:87:4e:50"/>
Aug 09 22:52:58 user nova-compute[72409]:   <model type="virtio"/>
Aug 09 22:52:58 user nova-compute[72409]:   <mtu size="1442"/>
Aug 09 22:52:58 user nova-compute[72409]:   <target dev="tap1320e771-b1"/>
Aug 09 22:52:58 user nova-compute[72409]: </interface>
Aug 09 22:52:58 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691621579.1047919, 7297de80-2674-4d9e-88e7-7a809bcf7381 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Start waiting for the detach event from libvirt for device tap1320e771-b1 with device alias net1 for instance 7297de80-2674-4d9e-88e7-7a809bcf7381 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:4e:50"/><model type="virtio"/><mtu size="1442"/><target dev="tap1320e771-b1"/></interface> {{(pid=72409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:87:4e:50"/><model type="virtio"/><mtu size="1442"/><target dev="tap1320e771-b1"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 09 22:52:59 user nova-compute[72409]:   <name>instance-00000007</name>
Aug 09 22:52:59 user nova-compute[72409]:   <uuid>7297de80-2674-4d9e-88e7-7a809bcf7381</uuid>
Aug 09 22:52:59 user nova-compute[72409]:   <metadata>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:52:59 user nova-compute[72409]:   <nova:package version="0.0.0"/>
Aug 09 22:52:59 user nova-compute[72409]:   <nova:name>tempest-device-tagging-server-850058011</nova:name>
Aug 09 22:52:59 user nova-compute[72409]:   <nova:creationTime>2023-08-09 22:52:30</nova:creationTime>
Aug 09 22:52:59 user nova-compute[72409]:   <nova:flavor name="m1.tiny">
Aug 09 22:52:59 user nova-compute[72409]:     <nova:memory>512</nova:memory>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:disk>1</nova:disk>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:swap>0</nova:swap>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:vcpus>1</nova:vcpus>
Aug 09 22:52:59 user nova-compute[72409]:   </nova:flavor>
Aug 09 22:52:59 user nova-compute[72409]:   <nova:owner>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:user uuid="25c4618cd6154fc6a3205d0b42f5a0f4">tempest-TaggedAttachmentsTest-12735973-project-member</nova:user>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:project uuid="c5ab01b4b8ef44a3b303aca035f69503">tempest-TaggedAttachmentsTest-12735973</nova:project>
Aug 09 22:52:59 user nova-compute[72409]:   </nova:owner>
Aug 09 22:52:59 user nova-compute[72409]:   <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:52:59 user nova-compute[72409]:   <nova:ports>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:port uuid="8c4beea2-41b0-4bf4-be54-170aa75d060a">
Aug 09 22:52:59 user nova-compute[72409]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 22:52:59 user nova-compute[72409]:     </nova:port>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:port uuid="1320e771-b1d9-439e-8d1d-7d0fe6553f7f">
Aug 09 22:52:59 user nova-compute[72409]:       <nova:ip type="fixed" address="10.10.10.178" ipVersion="4"/>
Aug 09 22:52:59 user nova-compute[72409]:     </nova:port>
Aug 09 22:52:59 user nova-compute[72409]:   </nova:ports>
Aug 09 22:52:59 user nova-compute[72409]: </nova:instance>
Aug 09 22:52:59 user nova-compute[72409]:   </metadata>
Aug 09 22:52:59 user nova-compute[72409]:   <memory unit='KiB'>524288</memory>
Aug 09 22:52:59 user nova-compute[72409]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 22:52:59 user nova-compute[72409]:   <vcpu placement='static'>1</vcpu>
Aug 09 22:52:59 user nova-compute[72409]:   <resource>
Aug 09 22:52:59 user nova-compute[72409]:     <partition>/machine</partition>
Aug 09 22:52:59 user nova-compute[72409]:   </resource>
Aug 09 22:52:59 user nova-compute[72409]:   <sysinfo type='smbios'>
Aug 09 22:52:59 user nova-compute[72409]:     <system>
Aug 09 22:52:59 user nova-compute[72409]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 22:52:59 user nova-compute[72409]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 22:52:59 user nova-compute[72409]:       <entry name='version'>0.0.0</entry>
Aug 09 22:52:59 user nova-compute[72409]:       <entry name='serial'>7297de80-2674-4d9e-88e7-7a809bcf7381</entry>
Aug 09 22:52:59 user nova-compute[72409]:       <entry name='uuid'>7297de80-2674-4d9e-88e7-7a809bcf7381</entry>
Aug 09 22:52:59 user nova-compute[72409]:       <entry name='family'>Virtual Machine</entry>
Aug 09 22:52:59 user nova-compute[72409]:     </system>
Aug 09 22:52:59 user nova-compute[72409]:   </sysinfo>
Aug 09 22:52:59 user nova-compute[72409]:   <os>
Aug 09 22:52:59 user nova-compute[72409]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 22:52:59 user nova-compute[72409]:     <boot dev='hd'/>
Aug 09 22:52:59 user nova-compute[72409]:     <smbios mode='sysinfo'/>
Aug 09 22:52:59 user nova-compute[72409]:   </os>
Aug 09 22:52:59 user nova-compute[72409]:   <features>
Aug 09 22:52:59 user nova-compute[72409]:     <acpi/>
Aug 09 22:52:59 user nova-compute[72409]:     <apic/>
Aug 09 22:52:59 user nova-compute[72409]:     <vmcoreinfo state='on'/>
Aug 09 22:52:59 user nova-compute[72409]:   </features>
Aug 09 22:52:59 user nova-compute[72409]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 22:52:59 user nova-compute[72409]:     <model fallback='forbid'>Nehalem</model>
Aug 09 22:52:59 user nova-compute[72409]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 22:52:59 user nova-compute[72409]:     <feature policy='require' name='vme'/>
Aug 09 22:52:59 user nova-compute[72409]:     <feature policy='require' name='x2apic'/>
Aug 09 22:52:59 user nova-compute[72409]:     <feature policy='require' name='hypervisor'/>
Aug 09 22:52:59 user nova-compute[72409]:   </cpu>
Aug 09 22:52:59 user nova-compute[72409]:   <clock offset='utc'>
Aug 09 22:52:59 user nova-compute[72409]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 22:52:59 user nova-compute[72409]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 22:52:59 user nova-compute[72409]:     <timer name='hpet' present='no'/>
Aug 09 22:52:59 user nova-compute[72409]:   </clock>
Aug 09 22:52:59 user nova-compute[72409]:   <on_poweroff>destroy</on_poweroff>
Aug 09 22:52:59 user nova-compute[72409]:   <on_reboot>restart</on_reboot>
Aug 09 22:52:59 user nova-compute[72409]:   <on_crash>destroy</on_crash>
Aug 09 22:52:59 user nova-compute[72409]:   <devices>
Aug 09 22:52:59 user nova-compute[72409]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 22:52:59 user nova-compute[72409]:     <disk type='file' device='disk'>
Aug 09 22:52:59 user nova-compute[72409]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 22:52:59 user nova-compute[72409]:       <source file='/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk' index='2'/>
Aug 09 22:52:59 user nova-compute[72409]:       <backingStore type='file' index='3'>
Aug 09 22:52:59 user nova-compute[72409]:         <format type='raw'/>
Aug 09 22:52:59 user nova-compute[72409]:         <source file='/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e'/>
Aug 09 22:52:59 user nova-compute[72409]:         <backingStore/>
Aug 09 22:52:59 user nova-compute[72409]:       </backingStore>
Aug 09 22:52:59 user nova-compute[72409]:       <target dev='vda' bus='virtio'/>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='virtio-disk0'/>
Aug 09 22:52:59 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 22:52:59 user nova-compute[72409]:     </disk>
Aug 09 22:52:59 user nova-compute[72409]:     <disk type='file' device='cdrom'>
Aug 09 22:52:59 user nova-compute[72409]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 22:52:59 user nova-compute[72409]:       <source file='/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/disk.config' index='1'/>
Aug 09 22:52:59 user nova-compute[72409]:       <backingStore/>
Aug 09 22:52:59 user nova-compute[72409]:       <target dev='hda' bus='ide'/>
Aug 09 22:52:59 user nova-compute[72409]:       <readonly/>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='ide0-0-0'/>
Aug 09 22:52:59 user nova-compute[72409]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 22:52:59 user nova-compute[72409]:     </disk>
Aug 09 22:52:59 user nova-compute[72409]:     <controller type='usb' index='0' model='none'>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='usb'/>
Aug 09 22:52:59 user nova-compute[72409]:     </controller>
Aug 09 22:52:59 user nova-compute[72409]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='pci.0'/>
Aug 09 22:52:59 user nova-compute[72409]:     </controller>
Aug 09 22:52:59 user nova-compute[72409]:     <controller type='ide' index='0'>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='ide'/>
Aug 09 22:52:59 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 22:52:59 user nova-compute[72409]:     </controller>
Aug 09 22:52:59 user nova-compute[72409]:     <interface type='ethernet'>
Aug 09 22:52:59 user nova-compute[72409]:       <mac address='fa:16:3e:1b:38:d8'/>
Aug 09 22:52:59 user nova-compute[72409]:       <target dev='tap8c4beea2-41'/>
Aug 09 22:52:59 user nova-compute[72409]:       <model type='virtio'/>
Aug 09 22:52:59 user nova-compute[72409]:       <mtu size='1442'/>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='net0'/>
Aug 09 22:52:59 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 22:52:59 user nova-compute[72409]:     </interface>
Aug 09 22:52:59 user nova-compute[72409]:     <serial type='pty'>
Aug 09 22:52:59 user nova-compute[72409]:       <source path='/dev/pts/6'/>
Aug 09 22:52:59 user nova-compute[72409]:       <log file='/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/console.log' append='off'/>
Aug 09 22:52:59 user nova-compute[72409]:       <target type='isa-serial' port='0'>
Aug 09 22:52:59 user nova-compute[72409]:         <model name='isa-serial'/>
Aug 09 22:52:59 user nova-compute[72409]:       </target>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='serial0'/>
Aug 09 22:52:59 user nova-compute[72409]:     </serial>
Aug 09 22:52:59 user nova-compute[72409]:     <console type='pty' tty='/dev/pts/6'>
Aug 09 22:52:59 user nova-compute[72409]:       <source path='/dev/pts/6'/>
Aug 09 22:52:59 user nova-compute[72409]:       <log file='/opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381/console.log' append='off'/>
Aug 09 22:52:59 user nova-compute[72409]:       <target type='serial' port='0'/>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='serial0'/>
Aug 09 22:52:59 user nova-compute[72409]:     </console>
Aug 09 22:52:59 user nova-compute[72409]:     <input type='mouse' bus='ps2'>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='input0'/>
Aug 09 22:52:59 user nova-compute[72409]:     </input>
Aug 09 22:52:59 user nova-compute[72409]:     <input type='keyboard' bus='ps2'>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='input1'/>
Aug 09 22:52:59 user nova-compute[72409]:     </input>
Aug 09 22:52:59 user nova-compute[72409]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 09 22:52:59 user nova-compute[72409]:       <listen type='address' address='0.0.0.0'/>
Aug 09 22:52:59 user nova-compute[72409]:     </graphics>
Aug 09 22:52:59 user nova-compute[72409]:     <audio id='1' type='none'/>
Aug 09 22:52:59 user nova-compute[72409]:     <video>
Aug 09 22:52:59 user nova-compute[72409]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='video0'/>
Aug 09 22:52:59 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 22:52:59 user nova-compute[72409]:     </video>
Aug 09 22:52:59 user nova-compute[72409]:     <memballoon model='virtio'>
Aug 09 22:52:59 user nova-compute[72409]:       <stats period='10'/>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='balloon0'/>
Aug 09 22:52:59 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 22:52:59 user nova-compute[72409]:     </memballoon>
Aug 09 22:52:59 user nova-compute[72409]:     <rng model='virtio'>
Aug 09 22:52:59 user nova-compute[72409]:       <backend model='random'>/dev/urandom</backend>
Aug 09 22:52:59 user nova-compute[72409]:       <alias name='rng0'/>
Aug 09 22:52:59 user nova-compute[72409]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 22:52:59 user nova-compute[72409]:     </rng>
Aug 09 22:52:59 user nova-compute[72409]:   </devices>
Aug 09 22:52:59 user nova-compute[72409]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 22:52:59 user nova-compute[72409]:     <label>libvirt-7297de80-2674-4d9e-88e7-7a809bcf7381</label>
Aug 09 22:52:59 user nova-compute[72409]:     <imagelabel>libvirt-7297de80-2674-4d9e-88e7-7a809bcf7381</imagelabel>
Aug 09 22:52:59 user nova-compute[72409]:   </seclabel>
Aug 09 22:52:59 user nova-compute[72409]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 22:52:59 user nova-compute[72409]:     <label>+64055:+108</label>
Aug 09 22:52:59 user nova-compute[72409]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 22:52:59 user nova-compute[72409]:   </seclabel>
Aug 09 22:52:59 user nova-compute[72409]: </domain>
Aug 09 22:52:59 user nova-compute[72409]:  {{(pid=72409) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 22:52:59 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Successfully detached device tap1320e771-b1 from instance 7297de80-2674-4d9e-88e7-7a809bcf7381 from the live domain config.
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850058011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850058011',id=7,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRPOKUNKx5r99nfeKMhpfm/VZ7AykvwNHlx19s63HAGjMBCMer6PwKksiSdO/uCgcrPPCs4Mdvnww76K8FCrlZ8SSpOgbs2r8XIKgBv2t3yYVeYOMw4Yjg1wzdcpPxGXQ==',key_name='tempest-keypair-1164357353',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5ab01b4b8ef44a3b303aca035f69503',ramdisk_id='',reservation_id='r-mufx0for',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-12735973',owner_user_name='tempest-TaggedAttachmentsTest-12735973-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c4618cd6154fc6a3205d0b42f5a0f4',uuid=7297de80-2674-4d9e-88e7-7a809bcf7381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "address": "fa:16:3e:87:4e:50", "network": {"id": "a009d746-7b48-4c39-9f73-e9cf5f9d5cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2098496432", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1320e771-b1", "ovs_interfaceid": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converting VIF {"id": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "address": "fa:16:3e:87:4e:50", "network": {"id": "a009d746-7b48-4c39-9f73-e9cf5f9d5cc3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2098496432", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1320e771-b1", "ovs_interfaceid": "1320e771-b1d9-439e-8d1d-7d0fe6553f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:50,bridge_name='br-int',has_traffic_filtering=True,id=1320e771-b1d9-439e-8d1d-7d0fe6553f7f,network=Network(a009d746-7b48-4c39-9f73-e9cf5f9d5cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1320e771-b1') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_vif [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:50,bridge_name='br-int',has_traffic_filtering=True,id=1320e771-b1d9-439e-8d1d-7d0fe6553f7f,network=Network(a009d746-7b48-4c39-9f73-e9cf5f9d5cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1320e771-b1') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1320e771-b1, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:52:59 user nova-compute[72409]: INFO os_vif [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:50,bridge_name='br-int',has_traffic_filtering=True,id=1320e771-b1d9-439e-8d1d-7d0fe6553f7f,network=Network(a009d746-7b48-4c39-9f73-e9cf5f9d5cc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1320e771-b1')
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:52:59 user nova-compute[72409]:   <nova:package version="0.0.0"/>
Aug 09 22:52:59 user nova-compute[72409]:   <nova:name>tempest-device-tagging-server-850058011</nova:name>
Aug 09 22:52:59 user nova-compute[72409]:   <nova:creationTime>2023-08-09 22:52:59</nova:creationTime>
Aug 09 22:52:59 user nova-compute[72409]:   <nova:flavor name="m1.tiny">
Aug 09 22:52:59 user nova-compute[72409]:     <nova:memory>512</nova:memory>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:disk>1</nova:disk>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:swap>0</nova:swap>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:vcpus>1</nova:vcpus>
Aug 09 22:52:59 user nova-compute[72409]:   </nova:flavor>
Aug 09 22:52:59 user nova-compute[72409]:   <nova:owner>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:user uuid="25c4618cd6154fc6a3205d0b42f5a0f4">tempest-TaggedAttachmentsTest-12735973-project-member</nova:user>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:project uuid="c5ab01b4b8ef44a3b303aca035f69503">tempest-TaggedAttachmentsTest-12735973</nova:project>
Aug 09 22:52:59 user nova-compute[72409]:   </nova:owner>
Aug 09 22:52:59 user nova-compute[72409]:   <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:52:59 user nova-compute[72409]:   <nova:ports>
Aug 09 22:52:59 user nova-compute[72409]:     <nova:port uuid="8c4beea2-41b0-4bf4-be54-170aa75d060a">
Aug 09 22:52:59 user nova-compute[72409]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 22:52:59 user nova-compute[72409]:     </nova:port>
Aug 09 22:52:59 user nova-compute[72409]:   </nova:ports>
Aug 09 22:52:59 user nova-compute[72409]: </nova:instance>
Aug 09 22:52:59 user nova-compute[72409]:  {{(pid=72409) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-be5c8c3d-0f7a-4457-87e1-fa01a3674afa req-6c50572e-d7d4-4626-901f-9e130fade535 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-vif-unplugged-1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-be5c8c3d-0f7a-4457-87e1-fa01a3674afa req-6c50572e-d7d4-4626-901f-9e130fade535 service nova] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-be5c8c3d-0f7a-4457-87e1-fa01a3674afa req-6c50572e-d7d4-4626-901f-9e130fade535 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-be5c8c3d-0f7a-4457-87e1-fa01a3674afa req-6c50572e-d7d4-4626-901f-9e130fade535 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-be5c8c3d-0f7a-4457-87e1-fa01a3674afa req-6c50572e-d7d4-4626-901f-9e130fade535 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] No waiting events found dispatching network-vif-unplugged-1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:52:59 user nova-compute[72409]: WARNING nova.compute.manager [req-be5c8c3d-0f7a-4457-87e1-fa01a3674afa req-6c50572e-d7d4-4626-901f-9e130fade535 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received unexpected event network-vif-unplugged-1320e771-b1d9-439e-8d1d-7d0fe6553f7f for instance with vm_state active and task_state None.
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_brick.utils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecc0a2f-21d9-4c4e-aeee-2a5124dc1395]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de9350b-6af6-420c-87ad-b2f95da986df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4efe58-beb1-4437-a2eb-933d4ea3b550]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6255525-5ba3-4d6f-bdaf-3aa96eb311e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:52:59 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f905555a-ae87-48aa-823b-560f0b3b3ba6]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_brick.utils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Updating existing volume attachment record: 522de426-8d8a-493f-ab99-3613b7a8ffb4 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621564.920023, 29a04807-1c46-4546-b78c-73d4f2b86c46 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:52:59 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] VM Stopped (Lifecycle Event)
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeusmTDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b', 'attached_at': '', 'detached_at': '', 'volume_id': '5634271d-4590-407f-a584-24202129b233', 'serial': '5634271d-4590-407f-a584-24202129b233'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahjEBkbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b', 'attached_at': '', 'detached_at': '', 'volume_id': '3725a632-aaa9-45b4-bc13-f872ea6ef99c', 'serial'} {{(pid=72409) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-27b9ac50-1450-4af0-b6ef-d12fa9b0435b None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeusmTDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:52:59 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:59 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:52:59 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce2ed59-1c2c-4ccb-ae16-3fafde97d007]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:52:59 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:52:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c0d756-cd0a-423e-9875-f1d6943e15e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233] added
Aug 09 22:53:00 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquired lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG nova.network.neutron [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8748faec-f6bb-421b-9fb1-3f305356f29a]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[38da9214-8668-42f9-80f4-9ad402379b18]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HeusmTDb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HeusmTDb" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c61a699-f55d-4aa9-8d57-4fdc2d97c140]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HeusmTDb'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a927cc-0c1d-4d03-a305-d86b97904c5c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a1174d-71b4-4c98-8fd8-2ca3892330ec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:53:00 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:53:00 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4f7dc5-0c50-42ed-a1d0-0166443ae287]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233, portal: 172.16.0.220,3260]
Aug 09 22:53:00 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233, portal: 172.16.0.220,3260] successful.
Aug 09 22:53:00 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c0b1a7-514d-40bf-8d5e-316941cc5bea]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f622d87-a42b-4219-9e69-efe17e21e419]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:53:00 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:53:00 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:53:00 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[42188433-238c-42a6-8be9-c5c0be3daf69]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:53:00 user nova-compute[72409]: INFO nova.network.neutron [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Port 1320e771-b1d9-439e-8d1d-7d0fe6553f7f from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 09 22:53:00 user nova-compute[72409]: DEBUG nova.network.neutron [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Updating instance_info_cache with network_info: [{"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Releasing lock "refresh_cache-7297de80-2674-4d9e-88e7-7a809bcf7381" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:53:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-578b2239-acec-470c-9cea-97605572e85c tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "interface-7297de80-2674-4d9e-88e7-7a809bcf7381-1320e771-b1d9-439e-8d1d-7d0fe6553f7f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.794s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeusmTDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23131373135313463', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131373135313463', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG nova.objects.instance [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lazy-loading 'flavor' on Instance uuid 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-6380ae1b-bbf7-49fd-9fe4-7c70ec06b6dc req-f7f1c5b4-300b-456e-bce6-16af4be70935 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-vif-plugged-1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6380ae1b-bbf7-49fd-9fe4-7c70ec06b6dc req-f7f1c5b4-300b-456e-bce6-16af4be70935 service nova] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6380ae1b-bbf7-49fd-9fe4-7c70ec06b6dc req-f7f1c5b4-300b-456e-bce6-16af4be70935 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6380ae1b-bbf7-49fd-9fe4-7c70ec06b6dc req-f7f1c5b4-300b-456e-bce6-16af4be70935 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-6380ae1b-bbf7-49fd-9fe4-7c70ec06b6dc req-f7f1c5b4-300b-456e-bce6-16af4be70935 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] No waiting events found dispatching network-vif-plugged-1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:01 user nova-compute[72409]: WARNING nova.compute.manager [req-6380ae1b-bbf7-49fd-9fe4-7c70ec06b6dc req-f7f1c5b4-300b-456e-bce6-16af4be70935 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received unexpected event network-vif-plugged-1320e771-b1d9-439e-8d1d-7d0fe6553f7f for instance with vm_state active and task_state None.
Aug 09 22:53:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-6380ae1b-bbf7-49fd-9fe4-7c70ec06b6dc req-f7f1c5b4-300b-456e-bce6-16af4be70935 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-vif-deleted-1320e771-b1d9-439e-8d1d-7d0fe6553f7f {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 131072000 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 320864256 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:03 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621568.0599878, 7b252875-ae91-4f8c-ae44-71097f9809a2 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:53:03 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] VM Stopped (Lifecycle Event)
Aug 09 22:53:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8e4e1681-87bc-473e-9961-aa1dd25c1d86 None None] [instance: 7b252875-ae91-4f8c-ae44-71097f9809a2] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 487587840 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 640679936 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 813694976 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 980418560 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:04 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621569.9674814, 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:53:04 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] VM Stopped (Lifecycle Event)
Aug 09 22:53:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c75ef954-de14-4c72-9d06-a1792301a750 None None] [instance: 202694e3-a5ae-48b9-bfa4-0eac9f27f5dd] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahjEBkbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:53:05 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[833ea637-a2de-407b-b223-0215a567e03d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c45f3e-fa8f-4334-93d3-3721c229172f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:05 user nova-compute[72409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:05 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:53:05 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:53:05 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:53:05 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:05 user nova-compute[72409]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:05 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:53:05 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:53:05 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:53:05 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e8453df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c'): ({'sdh'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Removing single pathed devices sdh {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[603cfb89-231a-43ab-a890-f03fdc04d5c4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bd9d20-8dd0-4c96-8399-a1fa887b6d47]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Flushing IO for device /dev/sdh {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5785f3-d9c9-449b-a1db-40cb63ec7569]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf299d03-a9a8-4038-b84f-24fadfa0befb]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] SCSI volumes sdh have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f2f83-5fae-4adb-a68a-745f295ece2c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[31579f95-8d1a-454a-bef6-76a581ce738a]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260]
Aug 09 22:53:05 user nova-compute[72409]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260] successful.
Aug 09 22:53:05 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b27688-6f1f-4ece-a0de-60ab741b8670]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] <== disconnect_volume: return (318ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeusmTDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b', 'attached_at': '', 'detached_at': '', 'volume_id': '5634271d-4590-407f-a584-24202129b233', 'serial'} {{(pid=72409) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 22:53:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] swap_volume: removing Cinder connection for volume 3725a632-aaa9-45b4-bc13-f872ea6ef99c {{(pid=72409) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 22:53:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] swap_volume: Updating volume 3725a632-aaa9-45b4-bc13-f872ea6ef99c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "HeusmTDb", "auth_password": "PGN0vA5zMCcJV3", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "5634271d-4590-407f-a584-24202129b233"}, "status": "reserved", "instance": "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b", "attached_at": "", "detached_at": "", "volume_id": "5634271d-4590-407f-a584-24202129b233", "serial": "5634271d-4590-407f-a584-24202129b233"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5634271d-4590-407f-a584-24202129b233', 'no_device': None, 'attachment_id': '1e9d8bdb-f8ab-42e5-b6eb-9acd4f9b58fe'} {{(pid=72409) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 22:53:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7134bf30-cc18-42c1-bd3f-452b34893eac tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.932s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG os_brick.utils [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ab3df4-5710-48ab-be51-b20f28721af1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[66145e07-71ba-4fd4-97ba-b3ca229edf20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[797cb9ef-f2b2-4111-9981-ca9806fb808d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbce309-78a8-4ce2-af06-f586213388d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:53:08 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:53:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09963ad-e2dc-4e26-bb3c-7628899db456]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:53:08 user nova-compute[72409]: DEBUG os_brick.utils [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:53:08 user nova-compute[72409]: INFO nova.compute.manager [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Swapping volume 5634271d-4590-407f-a584-24202129b233 for 3725a632-aaa9-45b4-bc13-f872ea6ef99c
Aug 09 22:53:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-e2b9b6dc-90b9-4367-a492-5d76dc3c1ca8 req-0d46f9a9-24e7-469b-b299-c0bd4d01816e service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-changed-98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-e2b9b6dc-90b9-4367-a492-5d76dc3c1ca8 req-0d46f9a9-24e7-469b-b299-c0bd4d01816e service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing instance network info cache due to event network-changed-98877804-c6b5-45ed-b69b-c502a0936e00. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:53:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e2b9b6dc-90b9-4367-a492-5d76dc3c1ca8 req-0d46f9a9-24e7-469b-b299-c0bd4d01816e service nova] Acquiring lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:53:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e2b9b6dc-90b9-4367-a492-5d76dc3c1ca8 req-0d46f9a9-24e7-469b-b299-c0bd4d01816e service nova] Acquired lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:53:09 user nova-compute[72409]: DEBUG nova.network.neutron [req-e2b9b6dc-90b9-4367-a492-5d76dc3c1ca8 req-0d46f9a9-24e7-469b-b299-c0bd4d01816e service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Refreshing network info cache for port 98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:53:10 user nova-compute[72409]: DEBUG nova.network.neutron [req-e2b9b6dc-90b9-4367-a492-5d76dc3c1ca8 req-0d46f9a9-24e7-469b-b299-c0bd4d01816e service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updated VIF entry in instance network info cache for port 98877804-c6b5-45ed-b69b-c502a0936e00. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:53:10 user nova-compute[72409]: DEBUG nova.network.neutron [req-e2b9b6dc-90b9-4367-a492-5d76dc3c1ca8 req-0d46f9a9-24e7-469b-b299-c0bd4d01816e service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating instance_info_cache with network_info: [{"id": "98877804-c6b5-45ed-b69b-c502a0936e00", "address": "fa:16:3e:0e:72:1d", "network": {"id": "4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-190846153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98877804-c6", "ovs_interfaceid": "98877804-c6b5-45ed-b69b-c502a0936e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "444f3835-540e-46ee-beb4-584610fa1054", "address": "fa:16:3e:54:71:95", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444f3835-54", "ovs_interfaceid": "444f3835-540e-46ee-beb4-584610fa1054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "address": "fa:16:3e:ec:64:0c", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e288dc-da", "ovs_interfaceid": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b031157-67a0-4cb0-960e-17042f18cf38", "address": "fa:16:3e:3b:28:a1", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b031157-67", "ovs_interfaceid": "2b031157-67a0-4cb0-960e-17042f18cf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "address": "fa:16:3e:f1:b5:12", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c682de9-37", "ovs_interfaceid": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "address": "fa:16:3e:29:4e:3e", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap755a9a96-52", "ovs_interfaceid": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f41052-45b3-4f52-81a2-854a211e59b0", "address": "fa:16:3e:50:07:25", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f41052-45", "ovs_interfaceid": "c1f41052-45b3-4f52-81a2-854a211e59b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e2b9b6dc-90b9-4367-a492-5d76dc3c1ca8 req-0d46f9a9-24e7-469b-b299-c0bd4d01816e service nova] Releasing lock "refresh_cache-162c9bef-7efd-480c-b49f-64c4c8f2616d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:53:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.009s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:12 user nova-compute[72409]: INFO nova.compute.manager [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Terminating instance
Aug 09 22:53:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-8ca695fd-2cc6-4c94-81d8-15ded51a796d req-c2d8add8-87e4-4ab2-b9e5-ea261b6754f6 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8ca695fd-2cc6-4c94-81d8-15ded51a796d req-c2d8add8-87e4-4ab2-b9e5-ea261b6754f6 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8ca695fd-2cc6-4c94-81d8-15ded51a796d req-c2d8add8-87e4-4ab2-b9e5-ea261b6754f6 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8ca695fd-2cc6-4c94-81d8-15ded51a796d req-c2d8add8-87e4-4ab2-b9e5-ea261b6754f6 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-8ca695fd-2cc6-4c94-81d8-15ded51a796d req-c2d8add8-87e4-4ab2-b9e5-ea261b6754f6 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-unplugged-98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-8ca695fd-2cc6-4c94-81d8-15ded51a796d req-c2d8add8-87e4-4ab2-b9e5-ea261b6754f6 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-98877804-c6b5-45ed-b69b-c502a0936e00 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-af096dc3-417c-4211-9573-408a9a5ab190 req-d7bb3f32-e64b-4b27-a94a-2bc3ccfd957b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-af096dc3-417c-4211-9573-408a9a5ab190 req-d7bb3f32-e64b-4b27-a94a-2bc3ccfd957b service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-af096dc3-417c-4211-9573-408a9a5ab190 req-d7bb3f32-e64b-4b27-a94a-2bc3ccfd957b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-af096dc3-417c-4211-9573-408a9a5ab190 req-d7bb3f32-e64b-4b27-a94a-2bc3ccfd957b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-af096dc3-417c-4211-9573-408a9a5ab190 req-d7bb3f32-e64b-4b27-a94a-2bc3ccfd957b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-unplugged-3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-af096dc3-417c-4211-9573-408a9a5ab190 req-d7bb3f32-e64b-4b27-a94a-2bc3ccfd957b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-3c682de9-37e0-4a27-8ae6-f24fdd328d65 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-ebed521a-ac88-433d-8210-0c88b590851d req-58e9b7e2-2d55-426b-bb87-d4290a40853d service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ebed521a-ac88-433d-8210-0c88b590851d req-58e9b7e2-2d55-426b-bb87-d4290a40853d service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ebed521a-ac88-433d-8210-0c88b590851d req-58e9b7e2-2d55-426b-bb87-d4290a40853d service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ebed521a-ac88-433d-8210-0c88b590851d req-58e9b7e2-2d55-426b-bb87-d4290a40853d service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-ebed521a-ac88-433d-8210-0c88b590851d req-58e9b7e2-2d55-426b-bb87-d4290a40853d service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-unplugged-755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-ebed521a-ac88-433d-8210-0c88b590851d req-58e9b7e2-2d55-426b-bb87-d4290a40853d service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-755a9a96-5271-4a79-b6ef-a2c2d4f843cf for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:53:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Instance destroyed successfully.
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lazy-loading 'resources' on Instance uuid 162c9bef-7efd-480c-b49f-64c4c8f2616d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:52:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98877804-c6b5-45ed-b69b-c502a0936e00", "address": "fa:16:3e:0e:72:1d", "network": {"id": "4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-190846153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98877804-c6", "ovs_interfaceid": "98877804-c6b5-45ed-b69b-c502a0936e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "98877804-c6b5-45ed-b69b-c502a0936e00", "address": "fa:16:3e:0e:72:1d", "network": {"id": "4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-190846153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98877804-c6", "ovs_interfaceid": "98877804-c6b5-45ed-b69b-c502a0936e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:72:1d,bridge_name='br-int',has_traffic_filtering=True,id=98877804-c6b5-45ed-b69b-c502a0936e00,network=Network(4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98877804-c6') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:72:1d,bridge_name='br-int',has_traffic_filtering=True,id=98877804-c6b5-45ed-b69b-c502a0936e00,network=Network(4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98877804-c6') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98877804-c6, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: INFO os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:72:1d,bridge_name='br-int',has_traffic_filtering=True,id=98877804-c6b5-45ed-b69b-c502a0936e00,network=Network(4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98877804-c6')
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:52:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "444f3835-540e-46ee-beb4-584610fa1054", "address": "fa:16:3e:54:71:95", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444f3835-54", "ovs_interfaceid": "444f3835-540e-46ee-beb4-584610fa1054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "444f3835-540e-46ee-beb4-584610fa1054", "address": "fa:16:3e:54:71:95", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444f3835-54", "ovs_interfaceid": "444f3835-540e-46ee-beb4-584610fa1054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:71:95,bridge_name='br-int',has_traffic_filtering=True,id=444f3835-540e-46ee-beb4-584610fa1054,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap444f3835-54') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:71:95,bridge_name='br-int',has_traffic_filtering=True,id=444f3835-540e-46ee-beb4-584610fa1054,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap444f3835-54') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap444f3835-54, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: INFO os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:71:95,bridge_name='br-int',has_traffic_filtering=True,id=444f3835-540e-46ee-beb4-584610fa1054,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap444f3835-54')
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:52:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "address": "fa:16:3e:ec:64:0c", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e288dc-da", "ovs_interfaceid": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "address": "fa:16:3e:ec:64:0c", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e288dc-da", "ovs_interfaceid": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:64:0c,bridge_name='br-int',has_traffic_filtering=True,id=91e288dc-da9b-4aa3-b687-e3d5d3c3a300,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91e288dc-da') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:64:0c,bridge_name='br-int',has_traffic_filtering=True,id=91e288dc-da9b-4aa3-b687-e3d5d3c3a300,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91e288dc-da') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91e288dc-da, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: INFO os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:64:0c,bridge_name='br-int',has_traffic_filtering=True,id=91e288dc-da9b-4aa3-b687-e3d5d3c3a300,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap91e288dc-da')
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:52:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b031157-67a0-4cb0-960e-17042f18cf38", "address": "fa:16:3e:3b:28:a1", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b031157-67", "ovs_interfaceid": "2b031157-67a0-4cb0-960e-17042f18cf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "2b031157-67a0-4cb0-960e-17042f18cf38", "address": "fa:16:3e:3b:28:a1", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b031157-67", "ovs_interfaceid": "2b031157-67a0-4cb0-960e-17042f18cf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b031157-67a0-4cb0-960e-17042f18cf38,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b031157-67') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b031157-67a0-4cb0-960e-17042f18cf38,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b031157-67') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b031157-67, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: INFO os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:28:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b031157-67a0-4cb0-960e-17042f18cf38,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b031157-67')
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:52:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "address": "fa:16:3e:f1:b5:12", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c682de9-37", "ovs_interfaceid": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "address": "fa:16:3e:f1:b5:12", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c682de9-37", "ovs_interfaceid": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b5:12,bridge_name='br-int',has_traffic_filtering=True,id=3c682de9-37e0-4a27-8ae6-f24fdd328d65,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c682de9-37') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b5:12,bridge_name='br-int',has_traffic_filtering=True,id=3c682de9-37e0-4a27-8ae6-f24fdd328d65,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c682de9-37') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c682de9-37, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: INFO os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:b5:12,bridge_name='br-int',has_traffic_filtering=True,id=3c682de9-37e0-4a27-8ae6-f24fdd328d65,network=Network(75b9e2c3-ed12-4e27-8127-c8f10edf04cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c682de9-37')
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:52:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "address": "fa:16:3e:29:4e:3e", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap755a9a96-52", "ovs_interfaceid": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "address": "fa:16:3e:29:4e:3e", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap755a9a96-52", "ovs_interfaceid": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:4e:3e,bridge_name='br-int',has_traffic_filtering=True,id=755a9a96-5271-4a79-b6ef-a2c2d4f843cf,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap755a9a96-52') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:4e:3e,bridge_name='br-int',has_traffic_filtering=True,id=755a9a96-5271-4a79-b6ef-a2c2d4f843cf,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap755a9a96-52') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap755a9a96-52, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: INFO os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:4e:3e,bridge_name='br-int',has_traffic_filtering=True,id=755a9a96-5271-4a79-b6ef-a2c2d4f843cf,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap755a9a96-52')
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2117004445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2117004445',id=11,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj0Gi4COO1VIjAC+uw+Q3URzG+UkvBmaPDJJrEbw+19oxwTOJexUNwf6Qlu1Z8LnYENBK2Fb2B+HBoHGiDhuH72kIM40jzMTu0bIaoOfjd1T85lPKh2FrvM5ZBmqBziXA==',key_name='tempest-keypair-824234320',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:52:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='102ecfc42f6141e79caca70bf05fb91c',ramdisk_id='',reservation_id='r-ag3q66jx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1203159757',owner_user_name='tempest-TaggedBootDevicesTest-1203159757-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='171e03db44fd471cb22befd584e5b8b4',uuid=162c9bef-7efd-480c-b49f-64c4c8f2616d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1f41052-45b3-4f52-81a2-854a211e59b0", "address": "fa:16:3e:50:07:25", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f41052-45", "ovs_interfaceid": "c1f41052-45b3-4f52-81a2-854a211e59b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converting VIF {"id": "c1f41052-45b3-4f52-81a2-854a211e59b0", "address": "fa:16:3e:50:07:25", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f41052-45", "ovs_interfaceid": "c1f41052-45b3-4f52-81a2-854a211e59b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:07:25,bridge_name='br-int',has_traffic_filtering=True,id=c1f41052-45b3-4f52-81a2-854a211e59b0,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f41052-45') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:07:25,bridge_name='br-int',has_traffic_filtering=True,id=c1f41052-45b3-4f52-81a2-854a211e59b0,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f41052-45') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1f41052-45, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:14 user nova-compute[72409]: INFO os_vif [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:07:25,bridge_name='br-int',has_traffic_filtering=True,id=c1f41052-45b3-4f52-81a2-854a211e59b0,network=Network(78710531-8afe-47b5-9369-56f229a52104),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f41052-45')
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXpwIsxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:53:14 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[478dd1ac-acbe-4075-8b33-f0ba8bc64cd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddf6e76-503d-4c80-8a60-4ef7654a4c28]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:53:14 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:53:14 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84540550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b7811a-053e-4649-86db-6075078107e1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9291c32-ae44-4ee6-8e11-1fc85247cefb]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9b9bf1-1452-443f-b7ff-bfc579a9dfa2]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a4dc97-74da-4bc8-8381-3f48bed582a3]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[addd9ebd-0058-4c0b-9768-f236e39554df]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a739571-8200-4f66-8663-0acebdd865ac]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b, portal: 172.16.0.220,3260]
Aug 09 22:53:14 user nova-compute[72409]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b, portal: 172.16.0.220,3260] successful.
Aug 09 22:53:14 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40114deb-0fc7-4ddb-92a4-098bbae1c44b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fc7c39-0b0a-4962-8bca-6cba3462e421]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] <== disconnect_volume: return (348ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYNQnvfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:53:14 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2d1e64-2df9-440c-aa37-0431a7f21c22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7ae27f-22cd-4da6-9c6d-e665941ff867]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:53:14 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 (non-flash)
Aug 09 22:53:14 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:53:14 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84542710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8'): ({'sdd'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Removing single pathed devices sdd {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:14 user nova-compute[72409]: WARNING nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-98877804-c6b5-45ed-b69b-c502a0936e00 for instance with vm_state active and task_state deleting.
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-444f3835-540e-46ee-beb4-584610fa1054 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-unplugged-444f3835-540e-46ee-beb4-584610fa1054 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-444f3835-540e-46ee-beb4-584610fa1054 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-444f3835-540e-46ee-beb4-584610fa1054 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-444f3835-540e-46ee-beb4-584610fa1054 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:14 user nova-compute[72409]: WARNING nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-444f3835-540e-46ee-beb4-584610fa1054 for instance with vm_state active and task_state deleting.
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-unplugged-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:14 user nova-compute[72409]: WARNING nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-91e288dc-da9b-4aa3-b687-e3d5d3c3a300 for instance with vm_state active and task_state deleting.
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-unplugged-2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-2b031157-67a0-4cb0-960e-17042f18cf38 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:14 user nova-compute[72409]: WARNING nova.compute.manager [req-8c0c8405-311e-444f-b05a-67cbc81db28c req-cf08eeb6-9259-4626-bd9a-04999e1c128b service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-2b031157-67a0-4cb0-960e-17042f18cf38 for instance with vm_state active and task_state deleting.
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb14210-b0f2-4f46-8fb3-bfb8f6216166]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d337780c-98c7-4d1e-bc33-c51fd228c5ad]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Flushing IO for device /dev/sdd {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[461a571b-d5cf-4f57-afb2-792e231604ff]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:53:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.154s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59ea661-7bec-4e07-ae07-0d27d9540441]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.267s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9923066e-db3e-4290-b2ad-f8441d17275b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-f405fd03-3118-458a-a169-2886bbf7520d req-ccce1bcd-3345-4ee2-bd48-70f2844d5c65 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f405fd03-3118-458a-a169-2886bbf7520d req-ccce1bcd-3345-4ee2-bd48-70f2844d5c65 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f405fd03-3118-458a-a169-2886bbf7520d req-ccce1bcd-3345-4ee2-bd48-70f2844d5c65 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f405fd03-3118-458a-a169-2886bbf7520d req-ccce1bcd-3345-4ee2-bd48-70f2844d5c65 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-f405fd03-3118-458a-a169-2886bbf7520d req-ccce1bcd-3345-4ee2-bd48-70f2844d5c65 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:15 user nova-compute[72409]: WARNING nova.compute.manager [req-f405fd03-3118-458a-a169-2886bbf7520d req-ccce1bcd-3345-4ee2-bd48-70f2844d5c65 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-3c682de9-37e0-4a27-8ae6-f24fdd328d65 for instance with vm_state active and task_state deleting.
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6371b40c-ea89-4ca7-907c-71bbff0c2706]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8, portal: 172.16.0.220,3260]
Aug 09 22:53:15 user nova-compute[72409]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8, portal: 172.16.0.220,3260] successful.
Aug 09 22:53:15 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66d8e1b3-2d63-42b8-88d8-31039efe58b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caa5644-e239-4474-84f6-eda6717d10d6]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.701s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] <== disconnect_volume: return (702ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdoKSmRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:53:15 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8557e1-c9f6-4888-9cbf-ce4644243345]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[78587af3-d059-49af-b77e-85867b5af525]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:15 user nova-compute[72409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:53:15 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:53:15 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:15 user nova-compute[72409]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:53:15 user nova-compute[72409]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf (non-flash)
Aug 09 22:53:15 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84542b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf'): ({'sde'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Removing single pathed devices sde {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-ac2c7761-89cc-4f24-a1be-a4505c3905b6 req-44860eb3-4ac5-4695-a679-2620d00eb6a7 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ac2c7761-89cc-4f24-a1be-a4505c3905b6 req-44860eb3-4ac5-4695-a679-2620d00eb6a7 service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ac2c7761-89cc-4f24-a1be-a4505c3905b6 req-44860eb3-4ac5-4695-a679-2620d00eb6a7 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ac2c7761-89cc-4f24-a1be-a4505c3905b6 req-44860eb3-4ac5-4695-a679-2620d00eb6a7 service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-ac2c7761-89cc-4f24-a1be-a4505c3905b6 req-44860eb3-4ac5-4695-a679-2620d00eb6a7 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:15 user nova-compute[72409]: WARNING nova.compute.manager [req-ac2c7761-89cc-4f24-a1be-a4505c3905b6 req-44860eb3-4ac5-4695-a679-2620d00eb6a7 service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-755a9a96-5271-4a79-b6ef-a2c2d4f843cf for instance with vm_state active and task_state deleting.
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[57893d81-7527-47aa-8423-71c1bc28d3f6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49fcc17-4ae6-4d93-9024-8f6040cd15ff]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Flushing IO for device /dev/sde {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[860cde47-0cb2-4d3c-92dd-5b64e719bb04]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7f1d3a-8370-45cb-bb44-e056f7076929]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4812c-b8b9-4982-8fbf-48e01803d901]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb1748a-0852-4502-ab28-6f934aab89a2]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf, portal: 172.16.0.220,3260]
Aug 09 22:53:15 user nova-compute[72409]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf, portal: 172.16.0.220,3260] successful.
Aug 09 22:53:15 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3971a75c-ba13-46c7-86ac-7992e186ffbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79eb997-4f4c-4cd0-ac2e-7948a5ca0e20]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] <== disconnect_volume: return (346ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:53:15 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Deleting instance files /opt/stack/data/nova/instances/162c9bef-7efd-480c-b49f-64c4c8f2616d_del
Aug 09 22:53:15 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Deletion of /opt/stack/data/nova/instances/162c9bef-7efd-480c-b49f-64c4c8f2616d_del complete
Aug 09 22:53:15 user nova-compute[72409]: INFO nova.compute.manager [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Took 3.51 seconds to destroy the instance on the hypervisor.
Aug 09 22:53:15 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:53:15 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.volume.cinder [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Update attachment failed for attachment 522de426-8d8a-493f-ab99-3613b7a8ffb4. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 was not found.).). (HTTP 500) (Request-ID: req-b65da4d6-a097-40c3-b5f5-9e867eab7607) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 was not found.).). (HTTP 500) (Request-ID: req-b65da4d6-a097-40c3-b5f5-9e867eab7607)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 was not found.).). (HTTP 500) (Request-ID: req-b65da4d6-a097-40c3-b5f5-9e867eab7607)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Traceback (most recent call last):
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     driver_block_device.attach_block_devices(
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     _log_and_attach(device)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     bdm.attach(*attach_args, **attach_kwargs)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/opt/stack/nova/nova/virt/block_device.py", line 852, in attach
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     super(DriverVolBlankBlockDevice, self).attach(
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     ret_val = method(obj, context, *args, **kwargs)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     self._do_attach(context, instance, volume, volume_api,
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     self._volume_attach(context, volume, connector, instance,
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     connection_info = volume_api.attachment_update(
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     res = method(self, ctx, *args, **kwargs)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     with excutils.save_and_reraise_exception():
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     self.force_reraise()
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     raise self.value
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     context, '3.44', skip_version_check=True).attachments.update(
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     return method.func(obj, *args, **kwargs)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     resp = self._update('/attachments/%s' % id, body)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     return self._cs_request(url, 'PUT', **kwargs)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     return self.request(url, method, **kwargs)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387]     raise exceptions.from_response(resp, body)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 was not found.).). (HTTP 500) (Request-ID: req-b65da4d6-a097-40c3-b5f5-9e867eab7607)
Aug 09 22:53:16 user nova-compute[72409]: ERROR nova.compute.manager [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] 
Aug 09 22:53:16 user nova-compute[72409]: DEBUG nova.compute.claims [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Aborting claim: <nova.compute.claims.Claim object at 0x7f4e940e9ba0> {{(pid=72409) abort /opt/stack/nova/nova/compute/claims.py:84}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-82cee0e3-ec1d-49ee-87c0-99a552f5286a req-04dc5172-efc4-4f08-b4f1-db9e06136fc5 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event volume-reimaged-531786d5-d1a0-48d4-9074-1d5dd0797145 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-82cee0e3-ec1d-49ee-87c0-99a552f5286a req-04dc5172-efc4-4f08-b4f1-db9e06136fc5 service nova] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-82cee0e3-ec1d-49ee-87c0-99a552f5286a req-04dc5172-efc4-4f08-b4f1-db9e06136fc5 service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-82cee0e3-ec1d-49ee-87c0-99a552f5286a req-04dc5172-efc4-4f08-b4f1-db9e06136fc5 service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-82cee0e3-ec1d-49ee-87c0-99a552f5286a req-04dc5172-efc4-4f08-b4f1-db9e06136fc5 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Processing event volume-reimaged-531786d5-d1a0-48d4-9074-1d5dd0797145 {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Instance event wait completed in 29 seconds for volume-reimaged {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-a6575ce4-0b5d-4ea7-a546-19d39ccd555e req-9bb2423a-be2d-4e48-8169-612c29d2ae8f service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a6575ce4-0b5d-4ea7-a546-19d39ccd555e req-9bb2423a-be2d-4e48-8169-612c29d2ae8f service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a6575ce4-0b5d-4ea7-a546-19d39ccd555e req-9bb2423a-be2d-4e48-8169-612c29d2ae8f service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a6575ce4-0b5d-4ea7-a546-19d39ccd555e req-9bb2423a-be2d-4e48-8169-612c29d2ae8f service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-a6575ce4-0b5d-4ea7-a546-19d39ccd555e req-9bb2423a-be2d-4e48-8169-612c29d2ae8f service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-unplugged-c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-a6575ce4-0b5d-4ea7-a546-19d39ccd555e req-9bb2423a-be2d-4e48-8169-612c29d2ae8f service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-unplugged-c1f41052-45b3-4f52-81a2-854a211e59b0 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-a6575ce4-0b5d-4ea7-a546-19d39ccd555e req-9bb2423a-be2d-4e48-8169-612c29d2ae8f service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-plugged-c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a6575ce4-0b5d-4ea7-a546-19d39ccd555e req-9bb2423a-be2d-4e48-8169-612c29d2ae8f service nova] Acquiring lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a6575ce4-0b5d-4ea7-a546-19d39ccd555e req-9bb2423a-be2d-4e48-8169-612c29d2ae8f service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a6575ce4-0b5d-4ea7-a546-19d39ccd555e req-9bb2423a-be2d-4e48-8169-612c29d2ae8f service nova] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-a6575ce4-0b5d-4ea7-a546-19d39ccd555e req-9bb2423a-be2d-4e48-8169-612c29d2ae8f service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] No waiting events found dispatching network-vif-plugged-c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:16 user nova-compute[72409]: WARNING nova.compute.manager [req-a6575ce4-0b5d-4ea7-a546-19d39ccd555e req-9bb2423a-be2d-4e48-8169-612c29d2ae8f service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received unexpected event network-vif-plugged-c1f41052-45b3-4f52-81a2-854a211e59b0 for instance with vm_state active and task_state deleting.
Aug 09 22:53:16 user nova-compute[72409]: INFO nova.virt.block_device [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Booting with volume 531786d5-d1a0-48d4-9074-1d5dd0797145 at /dev/vda
Aug 09 22:53:16 user nova-compute[72409]: DEBUG os_brick.utils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:53:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[71612277-88ae-4eeb-ae82-b4efd9e7ba48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f156a4-c7fa-4739-91ee-7c7a9811a4af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0173be7c-b9b0-4a5e-a011-d26636fe3a9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2281d0c-623b-4fb2-abe0-eab3168f8a88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:53:17 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[249646e7-1204-4f60-ae2d-57e8e85b02b9]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG os_brick.utils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Updating existing volume attachment record: 50f28f5b-8a23-470f-8520-e1dba872b750 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.480s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Build of instance e203577d-fa3b-4494-ad4e-7e65ad88b387 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 was not found.).). (HTTP 500) (Request-ID: req-b65da4d6-a097-40c3-b5f5-9e867eab7607) {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2644}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG nova.compute.utils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Build of instance e203577d-fa3b-4494-ad4e-7e65ad88b387 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b3970 {{(pid=72409) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Aug 09 22:53:17 user nova-compute[72409]: ERROR nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Build of instance e203577d-fa3b-4494-ad4e-7e65ad88b387 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 was not found.).). (HTTP 500) (Request-ID: req-b65da4d6-a097-40c3-b5f5-9e867eab7607): nova.exception.BuildAbortException: Build of instance e203577d-fa3b-4494-ad4e-7e65ad88b387 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:b3970c82-4441-4c01-8824-38b117fd9e00/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 was not found.).). (HTTP 500) (Request-ID: req-b65da4d6-a097-40c3-b5f5-9e867eab7607)
Aug 09 22:53:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Unplugging VIFs for instance {{(pid=72409) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2980}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1189990197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1189990197',id=12,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dfbbb5a1d134adba458e9c592f6fada',ramdisk_id='',reservation_id='r-5q87xdyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-426575742',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:52:53Z,user_data=None,user_id='8bf771a74e994703bd1ed49add72cd14',uuid=e203577d-fa3b-4494-ad4e-7e65ad88b387,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e4259ce-19e2-42bc-bd8d-b9e189f58336", "address": "fa:16:3e:44:83:09", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4259ce-19", "ovs_interfaceid": "6e4259ce-19e2-42bc-bd8d-b9e189f58336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converting VIF {"id": "6e4259ce-19e2-42bc-bd8d-b9e189f58336", "address": "fa:16:3e:44:83:09", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4259ce-19", "ovs_interfaceid": "6e4259ce-19e2-42bc-bd8d-b9e189f58336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:83:09,bridge_name='br-int',has_traffic_filtering=True,id=6e4259ce-19e2-42bc-bd8d-b9e189f58336,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4259ce-19') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG os_vif [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:83:09,bridge_name='br-int',has_traffic_filtering=True,id=6e4259ce-19e2-42bc-bd8d-b9e189f58336,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4259ce-19') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e4259ce-19, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:53:17 user nova-compute[72409]: INFO os_vif [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:83:09,bridge_name='br-int',has_traffic_filtering=True,id=6e4259ce-19e2-42bc-bd8d-b9e189f58336,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4259ce-19')
Aug 09 22:53:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Unplugged VIFs for instance {{(pid=72409) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3016}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:53:17 user nova-compute[72409]: DEBUG nova.network.neutron [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:53:18 user nova-compute[72409]: DEBUG nova.network.neutron [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:18 user nova-compute[72409]: INFO nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Took 1.71 seconds to deallocate network for instance.
Aug 09 22:53:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Detaching volume: b3970c82-4441-4c01-8824-38b117fd9e00 {{(pid=72409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3208}}
Aug 09 22:53:18 user nova-compute[72409]: INFO nova.compute.manager [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Detaching volume b3970c82-4441-4c01-8824-38b117fd9e00
Aug 09 22:53:19 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: e203577d-fa3b-4494-ad4e-7e65ad88b387] Skipping driver_detach during remote rebuild. {{(pid=72409) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Aug 09 22:53:19 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Deleted allocations for instance e203577d-fa3b-4494-ad4e-7e65ad88b387
Aug 09 22:53:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-79bff54b-3d49-4c82-b179-4f170667afc8 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "e203577d-fa3b-4494-ad4e-7e65ad88b387" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.034s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:20 user nova-compute[72409]: DEBUG nova.compute.manager [req-9126a73d-8a1c-4087-92be-6bad1c7ecf44 req-91007377-d269-4a3e-9aa1-b7f50f75bd3d service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-deleted-2b031157-67a0-4cb0-960e-17042f18cf38 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:20 user nova-compute[72409]: INFO nova.compute.manager [req-9126a73d-8a1c-4087-92be-6bad1c7ecf44 req-91007377-d269-4a3e-9aa1-b7f50f75bd3d service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Neutron deleted interface 2b031157-67a0-4cb0-960e-17042f18cf38; detaching it from the instance and deleting it from the info cache
Aug 09 22:53:20 user nova-compute[72409]: DEBUG nova.network.neutron [req-9126a73d-8a1c-4087-92be-6bad1c7ecf44 req-91007377-d269-4a3e-9aa1-b7f50f75bd3d service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating instance_info_cache with network_info: [{"id": "98877804-c6b5-45ed-b69b-c502a0936e00", "address": "fa:16:3e:0e:72:1d", "network": {"id": "4c57e2fa-dd52-4de4-9dd1-35ae96bf9c4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-190846153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98877804-c6", "ovs_interfaceid": "98877804-c6b5-45ed-b69b-c502a0936e00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "444f3835-540e-46ee-beb4-584610fa1054", "address": "fa:16:3e:54:71:95", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap444f3835-54", "ovs_interfaceid": "444f3835-540e-46ee-beb4-584610fa1054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "address": "fa:16:3e:ec:64:0c", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e288dc-da", "ovs_interfaceid": "91e288dc-da9b-4aa3-b687-e3d5d3c3a300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "address": "fa:16:3e:f1:b5:12", "network": {"id": "75b9e2c3-ed12-4e27-8127-c8f10edf04cb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1605236426", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c682de9-37", "ovs_interfaceid": "3c682de9-37e0-4a27-8ae6-f24fdd328d65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "address": "fa:16:3e:29:4e:3e", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap755a9a96-52", "ovs_interfaceid": "755a9a96-5271-4a79-b6ef-a2c2d4f843cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f41052-45b3-4f52-81a2-854a211e59b0", "address": "fa:16:3e:50:07:25", "network": {"id": "78710531-8afe-47b5-9369-56f229a52104", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388650853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "102ecfc42f6141e79caca70bf05fb91c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f41052-45", "ovs_interfaceid": "c1f41052-45b3-4f52-81a2-854a211e59b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-9126a73d-8a1c-4087-92be-6bad1c7ecf44 req-91007377-d269-4a3e-9aa1-b7f50f75bd3d service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Detach interface failed, port_id=2b031157-67a0-4cb0-960e-17042f18cf38, reason: Instance 162c9bef-7efd-480c-b49f-64c4c8f2616d could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 22:53:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:22 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:22 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Took 6.59 seconds to deallocate network for instance.
Aug 09 22:53:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-30a89dcd-6901-4386-a928-985c45cb73fd req-97f0fb0a-aed4-4cf6-a04a-a2295ec1c08a service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-deleted-98877804-c6b5-45ed-b69b-c502a0936e00 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-30a89dcd-6901-4386-a928-985c45cb73fd req-97f0fb0a-aed4-4cf6-a04a-a2295ec1c08a service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-deleted-c1f41052-45b3-4f52-81a2-854a211e59b0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-30a89dcd-6901-4386-a928-985c45cb73fd req-97f0fb0a-aed4-4cf6-a04a-a2295ec1c08a service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-deleted-3c682de9-37e0-4a27-8ae6-f24fdd328d65 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-30a89dcd-6901-4386-a928-985c45cb73fd req-97f0fb0a-aed4-4cf6-a04a-a2295ec1c08a service nova] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Received event network-vif-deleted-755a9a96-5271-4a79-b6ef-a2c2d4f843cf {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:24 user nova-compute[72409]: INFO nova.compute.manager [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Took 2.56 seconds to detach 3 volumes for instance.
Aug 09 22:53:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Acquiring lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Acquiring lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:25 user nova-compute[72409]: INFO nova.compute.manager [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Terminating instance
Aug 09 22:53:25 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:25 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Deleted allocations for instance 162c9bef-7efd-480c-b49f-64c4c8f2616d
Aug 09 22:53:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-11087dbe-2e17-4ab7-b4dd-49cd2b18c90a tempest-TaggedBootDevicesTest-1203159757 tempest-TaggedBootDevicesTest-1203159757-project-member] Lock "162c9bef-7efd-480c-b49f-64c4c8f2616d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.233s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-114e02bd-1cb3-4969-89fe-9bfd635c5366 req-8c43d3f8-21d5-4fdf-9653-aba2733d0d31 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Received event network-vif-unplugged-02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-114e02bd-1cb3-4969-89fe-9bfd635c5366 req-8c43d3f8-21d5-4fdf-9653-aba2733d0d31 service nova] Acquiring lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-114e02bd-1cb3-4969-89fe-9bfd635c5366 req-8c43d3f8-21d5-4fdf-9653-aba2733d0d31 service nova] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-114e02bd-1cb3-4969-89fe-9bfd635c5366 req-8c43d3f8-21d5-4fdf-9653-aba2733d0d31 service nova] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-114e02bd-1cb3-4969-89fe-9bfd635c5366 req-8c43d3f8-21d5-4fdf-9653-aba2733d0d31 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] No waiting events found dispatching network-vif-unplugged-02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-114e02bd-1cb3-4969-89fe-9bfd635c5366 req-8c43d3f8-21d5-4fdf-9653-aba2733d0d31 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Received event network-vif-unplugged-02736d2f-5ea1-41ca-9570-8e14feb041b1 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:53:25 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Instance destroyed successfully.
Aug 09 22:53:25 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lazy-loading 'resources' on Instance uuid bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-631960361',display_name='tempest-VolumesAssistedSnapshotsTest-server-631960361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-631960361',id=5,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHYQvohhzD4xzJdR/Kn/a1xGTYXgAH1A/IPzcOXr339v3C+1Q643bu7CwcK1o8oEILCll27zfvjzKfqokr4GlVTWvW7/rszZZE/vypqhcmjBdq2To29ZYcSym5yy+UhXA==',key_name='tempest-keypair-1932817062',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b22450125f542bba84d7ca1254adc42',ramdisk_id='',reservation_id='r-n90anrc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1432548145',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1432548145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='819be43af30b4457aaee0a715f532b7c',uuid=bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "address": "fa:16:3e:e0:3a:ad", "network": {"id": "4868dbae-2144-4a2a-aecb-fe9c4f0bc39a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-221632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b22450125f542bba84d7ca1254adc42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02736d2f-5e", "ovs_interfaceid": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Converting VIF {"id": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "address": "fa:16:3e:e0:3a:ad", "network": {"id": "4868dbae-2144-4a2a-aecb-fe9c4f0bc39a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-221632468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b22450125f542bba84d7ca1254adc42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02736d2f-5e", "ovs_interfaceid": "02736d2f-5ea1-41ca-9570-8e14feb041b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=02736d2f-5ea1-41ca-9570-8e14feb041b1,network=Network(4868dbae-2144-4a2a-aecb-fe9c4f0bc39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02736d2f-5e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG os_vif [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=02736d2f-5ea1-41ca-9570-8e14feb041b1,network=Network(4868dbae-2144-4a2a-aecb-fe9c4f0bc39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02736d2f-5e') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02736d2f-5e, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:53:26 user nova-compute[72409]: INFO os_vif [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=02736d2f-5ea1-41ca-9570-8e14feb041b1,network=Network(4868dbae-2144-4a2a-aecb-fe9c4f0bc39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02736d2f-5e')
Aug 09 22:53:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Deleting instance files /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c_del
Aug 09 22:53:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Deletion of /opt/stack/data/nova/instances/bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c_del complete
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahjEBkbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b', 'attached_at': '', 'detached_at': '', 'volume_id': '3725a632-aaa9-45b4-bc13-f872ea6ef99c', 'serial': '3725a632-aaa9-45b4-bc13-f872ea6ef99c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeusmTDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '5634271d-4590-407f-a584-24202129b233'}, 'status': 'reserved', 'instance': '2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b', 'attached_at': '', 'detached_at': '', 'volume_id': '5634271d-4590-407f-a584-24202129b233', 'serial'} {{(pid=72409) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahjEBkbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:53:26 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:53:26 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:53:26 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:53:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:26 user nova-compute[72409]: INFO nova.compute.manager [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dd2ab4-ee2b-4b0a-8c75-a7a394bc66cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:53:26 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1661fa-e097-47ff-9da6-1583379ff8cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c] added
Aug 09 22:53:26 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4e0153-933a-4bb5-88e9-49ad554e9df8]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8053161d-1b53-48de-a4e2-cf33a5a8b5e7]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahjEBkbO {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahjEBkbO" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b51d6d-ee2f-43b2-90de-f2698953e41f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ahjEBkbO'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae74995-a4e1-4eb3-a311-470dc9d6105b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[055e5f3e-ea9f-4549-aa5c-f72d16297617]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:26 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:26 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b347bbcb-24ff-4b75-bd8f-77602b09b09c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260]
Aug 09 22:53:26 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260] successful.
Aug 09 22:53:26 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d836b2-edbf-4514-96c1-ca1830c9a203]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd29595-a2ac-409e-a2c4-c2688ff9a082]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:26 user nova-compute[72409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:26 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:26 user nova-compute[72409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:26 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[982d7643-ac8d-4ab3-b1f8-63d74fd765c5]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahjEBkbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:53:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Creating image(s)
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Ensure instance console log exists: /opt/stack/data/nova/instances/29a04807-1c46-4546-b78c-73d4f2b86c46/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Start _get_guest_xml network_info=[{"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSJapLlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '29a04807-1c46-4546-b78c-73d4f2b86c46', 'attached_at': '', 'detached_at': '', 'volume_id': '531786d5-d1a0-48d4-9074-1d5dd0797145', 'serial': '531786d5-d1a0-48d4-9074-1d5dd0797145'}, 'mount_device': '/dev/vda', 'attachment_id': '50f28f5b-8a23-470f-8520-e1dba872b750', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:53:26 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 22:53:26 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.objects.instance [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lazy-loading 'vcpu_model' on Instance uuid 29a04807-1c46-4546-b78c-73d4f2b86c46 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSJapLlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:53:26 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 22:53:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23862613430656166', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862613430656166', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.637s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:53:27 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:53:27 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG nova.objects.instance [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lazy-loading 'flavor' on Instance uuid 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[533af90b-4f87-4e36-99b7-1526221be1fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:53:27 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b0a7e4-f358-4cc7-805e-85360d3c4386]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145] added
Aug 09 22:53:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ca6195-3d37-479c-85ed-11adf5cf3191]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3337ee4c-68b3-4cd4-a32d-30dab25699a7]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSJapLlB {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSJapLlB" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97ddf0e-8b39-4135-a896-16a81689ab56]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bSJapLlB'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7032828a-01f3-45ca-879a-2ee55c3cb405]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5734ca5f-0589-408f-aa21-ebd1d16822e0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:27 user nova-compute[72409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:27 user nova-compute[72409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:27 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Took 1.56 seconds to deallocate network for instance.
Aug 09 22:53:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-cd9d1a98-544a-40a0-a2a5-d981c0d5c139 req-9bf41cd7-ec20-4420-af51-92126ddda0b7 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Received event network-vif-deleted-02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:27 user nova-compute[72409]: INFO nova.compute.manager [req-cd9d1a98-544a-40a0-a2a5-d981c0d5c139 req-9bf41cd7-ec20-4420-af51-92126ddda0b7 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Neutron deleted interface 02736d2f-5ea1-41ca-9570-8e14feb041b1; detaching it from the instance and deleting it from the info cache
Aug 09 22:53:27 user nova-compute[72409]: DEBUG nova.network.neutron [req-cd9d1a98-544a-40a0-a2a5-d981c0d5c139 req-9bf41cd7-ec20-4420-af51-92126ddda0b7 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb85390-bac4-4a57-8c15-41acf6c2637f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260]
Aug 09 22:53:27 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260] successful.
Aug 09 22:53:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-cd9d1a98-544a-40a0-a2a5-d981c0d5c139 req-9bf41cd7-ec20-4420-af51-92126ddda0b7 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Detach interface failed, port_id=02736d2f-5ea1-41ca-9570-8e14feb041b1, reason: Instance bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d8816f-4300-4e6a-9dcb-c55b4bcda516]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-99ff11d3-88a9-4c3e-b767-63d561b4e168 req-d6545d45-5ed0-4620-8d70-0482166a15f5 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Received event network-vif-plugged-02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-99ff11d3-88a9-4c3e-b767-63d561b4e168 req-d6545d45-5ed0-4620-8d70-0482166a15f5 service nova] Acquiring lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-99ff11d3-88a9-4c3e-b767-63d561b4e168 req-d6545d45-5ed0-4620-8d70-0482166a15f5 service nova] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-99ff11d3-88a9-4c3e-b767-63d561b4e168 req-d6545d45-5ed0-4620-8d70-0482166a15f5 service nova] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-99ff11d3-88a9-4c3e-b767-63d561b4e168 req-d6545d45-5ed0-4620-8d70-0482166a15f5 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] No waiting events found dispatching network-vif-plugged-02736d2f-5ea1-41ca-9570-8e14feb041b1 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:27 user nova-compute[72409]: WARNING nova.compute.manager [req-99ff11d3-88a9-4c3e-b767-63d561b4e168 req-d6545d45-5ed0-4620-8d70-0482166a15f5 service nova] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Received unexpected event network-vif-plugged-02736d2f-5ea1-41ca-9570-8e14feb041b1 for instance with vm_state active and task_state deleting.
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d7f64b-796c-4e78-b411-9ceb4abe5090]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:27 user nova-compute[72409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:27 user nova-compute[72409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:53:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:27 user nova-compute[72409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:27 user nova-compute[72409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:53:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6017a530-a396-4878-b4a9-48ea9776f2a6]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSJapLlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:53:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:28 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Deleted allocations for instance bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c
Aug 09 22:53:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c7175706-7620-42a4-9643-7f9b0da149cc tempest-VolumesAssistedSnapshotsTest-1432548145 tempest-VolumesAssistedSnapshotsTest-1432548145-project-member] Lock "bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.198s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] <== connect_volume: return (2000ms) {'type': 'block', 'scsi_wwn': '26234666139663766', 'path': '/dev/sdd'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234666139663766', 'path': '/dev/sdd'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T22:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-632707458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1227232666',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAoSaQCdVvuh57WXjFA13EBow7aKBmqRgJwb6HwSpyFB+eussplICF19CzXtR/xzCNYd09zaCo7OZWi2arzQlCx/TWpdlW31VSARWFAbCK5rWCe0CK613+EMVVBpM3mvg==',key_name='tempest-keypair-1505891920',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:51:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='501f4894d8ce46d08a02baf924d7e51e',ramdisk_id='',reservation_id='r-6hu0v00n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1870090794',owner_user_name='tempest-ServerActionsV293TestJSON-1870090794-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:53:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be4e91cf0054f548ea7a1d75426b72b',uuid=29a04807-1c46-4546-b78c-73d4f2b86c46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Converting VIF {"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:53:28 user nova-compute[72409]:   <uuid>29a04807-1c46-4546-b78c-73d4f2b86c46</uuid>
Aug 09 22:53:28 user nova-compute[72409]:   <name>instance-0000000a</name>
Aug 09 22:53:28 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:53:28 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:53:28 user nova-compute[72409]:   <metadata>
Aug 09 22:53:28 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:53:28 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:53:28 user nova-compute[72409]:       <nova:name>tempest-ServerActionsV293TestJSON-server-632707458</nova:name>
Aug 09 22:53:28 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:53:26</nova:creationTime>
Aug 09 22:53:28 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:53:28 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:53:28 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:53:28 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:53:28 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:53:28 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:53:28 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:53:28 user nova-compute[72409]:       <nova:owner>
Aug 09 22:53:28 user nova-compute[72409]:         <nova:user uuid="0be4e91cf0054f548ea7a1d75426b72b">tempest-ServerActionsV293TestJSON-1870090794-project-member</nova:user>
Aug 09 22:53:28 user nova-compute[72409]:         <nova:project uuid="501f4894d8ce46d08a02baf924d7e51e">tempest-ServerActionsV293TestJSON-1870090794</nova:project>
Aug 09 22:53:28 user nova-compute[72409]:       </nova:owner>
Aug 09 22:53:28 user nova-compute[72409]:       <nova:ports>
Aug 09 22:53:28 user nova-compute[72409]:         <nova:port uuid="c37915d3-63af-47d7-8618-adee0e79e4ce">
Aug 09 22:53:28 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 22:53:28 user nova-compute[72409]:         </nova:port>
Aug 09 22:53:28 user nova-compute[72409]:       </nova:ports>
Aug 09 22:53:28 user nova-compute[72409]:     </nova:instance>
Aug 09 22:53:28 user nova-compute[72409]:   </metadata>
Aug 09 22:53:28 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:53:28 user nova-compute[72409]:     <system>
Aug 09 22:53:28 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:53:28 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:53:28 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:53:28 user nova-compute[72409]:       <entry name="serial">29a04807-1c46-4546-b78c-73d4f2b86c46</entry>
Aug 09 22:53:28 user nova-compute[72409]:       <entry name="uuid">29a04807-1c46-4546-b78c-73d4f2b86c46</entry>
Aug 09 22:53:28 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:53:28 user nova-compute[72409]:     </system>
Aug 09 22:53:28 user nova-compute[72409]:   </sysinfo>
Aug 09 22:53:28 user nova-compute[72409]:   <os>
Aug 09 22:53:28 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:53:28 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:53:28 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:53:28 user nova-compute[72409]:   </os>
Aug 09 22:53:28 user nova-compute[72409]:   <features>
Aug 09 22:53:28 user nova-compute[72409]:     <acpi/>
Aug 09 22:53:28 user nova-compute[72409]:     <apic/>
Aug 09 22:53:28 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:53:28 user nova-compute[72409]:   </features>
Aug 09 22:53:28 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:53:28 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:53:28 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:53:28 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:53:28 user nova-compute[72409]:   </clock>
Aug 09 22:53:28 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:53:28 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:53:28 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:53:28 user nova-compute[72409]:   </cpu>
Aug 09 22:53:28 user nova-compute[72409]:   <devices>
Aug 09 22:53:28 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:53:28 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:53:28 user nova-compute[72409]:       <source dev="/dev/sdd"/>
Aug 09 22:53:28 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:53:28 user nova-compute[72409]:       <serial>531786d5-d1a0-48d4-9074-1d5dd0797145</serial>
Aug 09 22:53:28 user nova-compute[72409]:     </disk>
Aug 09 22:53:28 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:53:28 user nova-compute[72409]:       <mac address="fa:16:3e:e3:4b:f8"/>
Aug 09 22:53:28 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:53:28 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:53:28 user nova-compute[72409]:       <target dev="tapc37915d3-63"/>
Aug 09 22:53:28 user nova-compute[72409]:     </interface>
Aug 09 22:53:28 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:53:28 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/29a04807-1c46-4546-b78c-73d4f2b86c46/console.log" append="off"/>
Aug 09 22:53:28 user nova-compute[72409]:     </serial>
Aug 09 22:53:28 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:53:28 user nova-compute[72409]:     <video>
Aug 09 22:53:28 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:53:28 user nova-compute[72409]:     </video>
Aug 09 22:53:28 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:53:28 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:53:28 user nova-compute[72409]:     </rng>
Aug 09 22:53:28 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:53:28 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:53:28 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:53:28 user nova-compute[72409]:     </memballoon>
Aug 09 22:53:28 user nova-compute[72409]:   </devices>
Aug 09 22:53:28 user nova-compute[72409]: </domain>
Aug 09 22:53:28 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T22:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-632707458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1227232666',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAoSaQCdVvuh57WXjFA13EBow7aKBmqRgJwb6HwSpyFB+eussplICF19CzXtR/xzCNYd09zaCo7OZWi2arzQlCx/TWpdlW31VSARWFAbCK5rWCe0CK613+EMVVBpM3mvg==',key_name='tempest-keypair-1505891920',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:51:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='501f4894d8ce46d08a02baf924d7e51e',ramdisk_id='',reservation_id='r-6hu0v00n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1870090794',owner_user_name='tempest-ServerActionsV293TestJSON-1870090794-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:53:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be4e91cf0054f548ea7a1d75426b72b',uuid=29a04807-1c46-4546-b78c-73d4f2b86c46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Converting VIF {"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG os_vif [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc37915d3-63, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc37915d3-63, col_values=(('external_ids', {'iface-id': 'c37915d3-63af-47d7-8618-adee0e79e4ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:4b:f8', 'vm-uuid': '29a04807-1c46-4546-b78c-73d4f2b86c46'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:53:28 user nova-compute[72409]: INFO os_vif [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63')
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 310378496 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:53:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] No VIF found with MAC fa:16:3e:e3:4b:f8, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:53:29 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621594.017559, 162c9bef-7efd-480c-b49f-64c4c8f2616d => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:53:29 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] VM Stopped (Lifecycle Event)
Aug 09 22:53:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0865939f-003a-4bdc-bd33-7eb8cf513324 None None] [instance: 162c9bef-7efd-480c-b49f-64c4c8f2616d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 465567744 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 583008256 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 751828992 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 920649728 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-1634a1b7-c966-4ff7-8794-73ed22ead302 req-5f1680bb-1d1a-44fb-a59a-204a4961f250 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1634a1b7-c966-4ff7-8794-73ed22ead302 req-5f1680bb-1d1a-44fb-a59a-204a4961f250 service nova] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1634a1b7-c966-4ff7-8794-73ed22ead302 req-5f1680bb-1d1a-44fb-a59a-204a4961f250 service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1634a1b7-c966-4ff7-8794-73ed22ead302 req-5f1680bb-1d1a-44fb-a59a-204a4961f250 service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-1634a1b7-c966-4ff7-8794-73ed22ead302 req-5f1680bb-1d1a-44fb-a59a-204a4961f250 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] No waiting events found dispatching network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:31 user nova-compute[72409]: WARNING nova.compute.manager [req-1634a1b7-c966-4ff7-8794-73ed22ead302 req-5f1680bb-1d1a-44fb-a59a-204a4961f250 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received unexpected event network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce for instance with vm_state active and task_state rebuild_spawning.
Aug 09 22:53:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 1058013184 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HeusmTDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '5634271d-4590-407f-a584-24202129b233'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:53:32 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ec13ea-bfae-4be8-afea-ef00b294bf67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[270688a0-77cf-422c-9618-9ca1221912fa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:32 user nova-compute[72409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:32 user nova-compute[72409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:53:32 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 (non-flash)
Aug 09 22:53:32 user nova-compute[72409]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:32 user nova-compute[72409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:53:32 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e942e7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89d5a67-ac0d-43e1-9ec8-2ff1543339e7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf4b275-164a-4fc7-9cdd-17e94cacc65f]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2852ea8-7836-4985-886a-b2c017f4519e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f549951-a89b-4f66-a036-c6834668ae6a]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[560e937c-d273-4a60-983f-f1051def617e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3113e028-1fb6-4dbc-a6d3-f223bdf40526]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233, portal: 172.16.0.220,3260]
Aug 09 22:53:32 user nova-compute[72409]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233, portal: 172.16.0.220,3260] successful.
Aug 09 22:53:32 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5634271d-4590-407f-a584-24202129b233 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f328916-bb34-4bca-91ae-288e5e8a2fd8]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] <== disconnect_volume: return (269ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahjEBkbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b', 'attached_at': '', 'detached_at': '', 'volume_id': '3725a632-aaa9-45b4-bc13-f872ea6ef99c', 'serial'} {{(pid=72409) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] swap_volume: removing Cinder connection for volume 5634271d-4590-407f-a584-24202129b233 {{(pid=72409) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621612.8931777, 29a04807-1c46-4546-b78c-73d4f2b86c46 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:53:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] VM Resumed (Lifecycle Event)
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:53:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Instance spawned successfully.
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621612.894238, 29a04807-1c46-4546-b78c-73d4f2b86c46 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:53:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] VM Started (Lifecycle Event)
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:53:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 22:53:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:33 user nova-compute[72409]: DEBUG nova.objects.instance [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72409) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 22:53:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-82cee0e3-ec1d-49ee-87c0-99a552f5286a tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.069s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] swap_volume: Updating volume 5634271d-4590-407f-a584-24202129b233 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "ahjEBkbO", "auth_password": "VYj4AztbG5xT9y", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "3725a632-aaa9-45b4-bc13-f872ea6ef99c"}, "status": "reserved", "instance": "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b", "attached_at": "", "detached_at": "", "volume_id": "3725a632-aaa9-45b4-bc13-f872ea6ef99c", "serial": "3725a632-aaa9-45b4-bc13-f872ea6ef99c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3725a632-aaa9-45b4-bc13-f872ea6ef99c', 'no_device': None, 'attachment_id': '8fa2fb9b-180e-47e4-ad1e-7829c5bde4da'} {{(pid=72409) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 22:53:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-89656de6-7df8-4951-a15e-748fd9251732 tempest-TestVolumeSwap-262544568 tempest-TestVolumeSwap-262544568-project-admin] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 25.125s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-ab8140e3-3c7d-49d8-a4a8-1d6705d03824 req-22f719ae-06ae-4eae-9202-0fefbf253729 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ab8140e3-3c7d-49d8-a4a8-1d6705d03824 req-22f719ae-06ae-4eae-9202-0fefbf253729 service nova] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ab8140e3-3c7d-49d8-a4a8-1d6705d03824 req-22f719ae-06ae-4eae-9202-0fefbf253729 service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ab8140e3-3c7d-49d8-a4a8-1d6705d03824 req-22f719ae-06ae-4eae-9202-0fefbf253729 service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-ab8140e3-3c7d-49d8-a4a8-1d6705d03824 req-22f719ae-06ae-4eae-9202-0fefbf253729 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] No waiting events found dispatching network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:33 user nova-compute[72409]: WARNING nova.compute.manager [req-ab8140e3-3c7d-49d8-a4a8-1d6705d03824 req-22f719ae-06ae-4eae-9202-0fefbf253729 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received unexpected event network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce for instance with vm_state active and task_state None.
Aug 09 22:53:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:34 user nova-compute[72409]: INFO nova.compute.manager [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Detaching volume 3725a632-aaa9-45b4-bc13-f872ea6ef99c
Aug 09 22:53:34 user nova-compute[72409]: INFO nova.virt.block_device [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Attempting to driver detach volume 3725a632-aaa9-45b4-bc13-f872ea6ef99c from mountpoint /dev/vdb
Aug 09 22:53:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Attempting to detach device vdb from instance 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 22:53:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 22:53:34 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:53:34 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 22:53:34 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:53:34 user nova-compute[72409]:   <serial>3725a632-aaa9-45b4-bc13-f872ea6ef99c</serial>
Aug 09 22:53:34 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 22:53:34 user nova-compute[72409]: </disk>
Aug 09 22:53:34 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:53:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Successfully detached device vdb from instance 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b from the persistent domain config.
Aug 09 22:53:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 22:53:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 22:53:34 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:53:34 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 22:53:34 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:53:34 user nova-compute[72409]:   <serial>3725a632-aaa9-45b4-bc13-f872ea6ef99c</serial>
Aug 09 22:53:34 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 22:53:34 user nova-compute[72409]: </disk>
Aug 09 22:53:34 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:53:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "1f17088d-95df-44c9-aac2-24eced6fde25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "1f17088d-95df-44c9-aac2-24eced6fde25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:53:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:53:34 user nova-compute[72409]: INFO nova.compute.claims [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Claim successful on node user
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691621615.0906436, 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 22:53:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Successfully detached device vdb from instance 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b from the live domain config.
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahjEBkbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '3725a632-aaa9-45b4-bc13-f872ea6ef99c'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:53:35 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b49486a-737b-4188-900d-a41205e0c057]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.network.neutron [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5550c0ef-4aa2-4ab5-91d9-9a3a4e0b018f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:35 user nova-compute[72409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:53:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c (non-flash)
Aug 09 22:53:35 user nova-compute[72409]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:53:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e94107400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:53:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedf9797-c04b-47b0-93f2-af34dbff1e57]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ae5cb8-e91e-43c6-b0cb-8e79bfa6ef8f]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d40e0a4-d38c-443e-ad2f-bad73ac64811]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.policy [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5567e41fceda4b8abf8d8d56a8bab9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3700dd59a4548ca8e2ec8dd02ecc6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf07dc1-a2c4-4c90-a004-25c8ba63e4e2]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d8bf26-ff77-432a-b424-81be38c0bacf]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:53:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Creating image(s)
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "/opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "/opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ad3e6d-dc2f-4e85-aaf2-4044051edefe]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260]
Aug 09 22:53:35 user nova-compute[72409]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c, portal: 172.16.0.220,3260] successful.
Aug 09 22:53:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3725a632-aaa9-45b4-bc13-f872ea6ef99c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e534a372-34b2-4293-9875-50015fd5df82]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] <== disconnect_volume: return (348ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk 1073741824" returned: 0 in 0.054s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.149s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:35 user nova-compute[72409]: DEBUG nova.network.neutron [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Successfully created port: d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Cannot resize image /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG nova.objects.instance [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lazy-loading 'migration_context' on Instance uuid 1f17088d-95df-44c9-aac2-24eced6fde25 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Ensure instance console log exists: /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG nova.network.neutron [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Successfully updated port: d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "refresh_cache-1f17088d-95df-44c9-aac2-24eced6fde25" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquired lock "refresh_cache-1f17088d-95df-44c9-aac2-24eced6fde25" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG nova.network.neutron [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-276df821-ff87-48ee-b593-c03d59d4f762 req-4832c67f-54c2-4e19-9520-4bffbc82b9e2 service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Received event network-changed-d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-276df821-ff87-48ee-b593-c03d59d4f762 req-4832c67f-54c2-4e19-9520-4bffbc82b9e2 service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Refreshing instance network info cache due to event network-changed-d2fcb0c2-e923-4f89-9911-c76e982dd729. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:53:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-276df821-ff87-48ee-b593-c03d59d4f762 req-4832c67f-54c2-4e19-9520-4bffbc82b9e2 service nova] Acquiring lock "refresh_cache-1f17088d-95df-44c9-aac2-24eced6fde25" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lazy-loading 'flavor' on Instance uuid 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1cd6c35-d7b0-4368-8069-a5fc2722f856 tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.834s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Updating instance_info_cache with network_info: [{"id": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "address": "fa:16:3e:71:83:eb", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fcb0c2-e9", "ovs_interfaceid": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Releasing lock "refresh_cache-1f17088d-95df-44c9-aac2-24eced6fde25" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Instance network_info: |[{"id": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "address": "fa:16:3e:71:83:eb", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fcb0c2-e9", "ovs_interfaceid": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-276df821-ff87-48ee-b593-c03d59d4f762 req-4832c67f-54c2-4e19-9520-4bffbc82b9e2 service nova] Acquired lock "refresh_cache-1f17088d-95df-44c9-aac2-24eced6fde25" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.network.neutron [req-276df821-ff87-48ee-b593-c03d59d4f762 req-4832c67f-54c2-4e19-9520-4bffbc82b9e2 service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Refreshing network info cache for port d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Start _get_guest_xml network_info=[{"id": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "address": "fa:16:3e:71:83:eb", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fcb0c2-e9", "ovs_interfaceid": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:53:37 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:53:37 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-623150734',display_name='tempest-VolumesAdminNegativeTest-server-623150734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-623150734',id=13,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3700dd59a4548ca8e2ec8dd02ecc6a7',ramdisk_id='',reservation_id='r-4qvzlmvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-994899237',owner_user_name='tempest-VolumesAdminNegativeTest-994899237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:53:35Z,user_data=None,user_id='5567e41fceda4b8abf8d8d56a8bab9b2',uuid=1f17088d-95df-44c9-aac2-24eced6fde25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "address": "fa:16:3e:71:83:eb", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fcb0c2-e9", "ovs_interfaceid": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Converting VIF {"id": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "address": "fa:16:3e:71:83:eb", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fcb0c2-e9", "ovs_interfaceid": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:83:eb,bridge_name='br-int',has_traffic_filtering=True,id=d2fcb0c2-e923-4f89-9911-c76e982dd729,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fcb0c2-e9') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.objects.instance [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f17088d-95df-44c9-aac2-24eced6fde25 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:53:37 user nova-compute[72409]:   <uuid>1f17088d-95df-44c9-aac2-24eced6fde25</uuid>
Aug 09 22:53:37 user nova-compute[72409]:   <name>instance-0000000d</name>
Aug 09 22:53:37 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:53:37 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:53:37 user nova-compute[72409]:   <metadata>
Aug 09 22:53:37 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:53:37 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:53:37 user nova-compute[72409]:       <nova:name>tempest-VolumesAdminNegativeTest-server-623150734</nova:name>
Aug 09 22:53:37 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:53:37</nova:creationTime>
Aug 09 22:53:37 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:53:37 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:53:37 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:53:37 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:53:37 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:53:37 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:53:37 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:53:37 user nova-compute[72409]:       <nova:owner>
Aug 09 22:53:37 user nova-compute[72409]:         <nova:user uuid="5567e41fceda4b8abf8d8d56a8bab9b2">tempest-VolumesAdminNegativeTest-994899237-project-member</nova:user>
Aug 09 22:53:37 user nova-compute[72409]:         <nova:project uuid="b3700dd59a4548ca8e2ec8dd02ecc6a7">tempest-VolumesAdminNegativeTest-994899237</nova:project>
Aug 09 22:53:37 user nova-compute[72409]:       </nova:owner>
Aug 09 22:53:37 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:53:37 user nova-compute[72409]:       <nova:ports>
Aug 09 22:53:37 user nova-compute[72409]:         <nova:port uuid="d2fcb0c2-e923-4f89-9911-c76e982dd729">
Aug 09 22:53:37 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 22:53:37 user nova-compute[72409]:         </nova:port>
Aug 09 22:53:37 user nova-compute[72409]:       </nova:ports>
Aug 09 22:53:37 user nova-compute[72409]:     </nova:instance>
Aug 09 22:53:37 user nova-compute[72409]:   </metadata>
Aug 09 22:53:37 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:53:37 user nova-compute[72409]:     <system>
Aug 09 22:53:37 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:53:37 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:53:37 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:53:37 user nova-compute[72409]:       <entry name="serial">1f17088d-95df-44c9-aac2-24eced6fde25</entry>
Aug 09 22:53:37 user nova-compute[72409]:       <entry name="uuid">1f17088d-95df-44c9-aac2-24eced6fde25</entry>
Aug 09 22:53:37 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:53:37 user nova-compute[72409]:     </system>
Aug 09 22:53:37 user nova-compute[72409]:   </sysinfo>
Aug 09 22:53:37 user nova-compute[72409]:   <os>
Aug 09 22:53:37 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:53:37 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:53:37 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:53:37 user nova-compute[72409]:   </os>
Aug 09 22:53:37 user nova-compute[72409]:   <features>
Aug 09 22:53:37 user nova-compute[72409]:     <acpi/>
Aug 09 22:53:37 user nova-compute[72409]:     <apic/>
Aug 09 22:53:37 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:53:37 user nova-compute[72409]:   </features>
Aug 09 22:53:37 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:53:37 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:53:37 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:53:37 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:53:37 user nova-compute[72409]:   </clock>
Aug 09 22:53:37 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:53:37 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:53:37 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:53:37 user nova-compute[72409]:   </cpu>
Aug 09 22:53:37 user nova-compute[72409]:   <devices>
Aug 09 22:53:37 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:53:37 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:53:37 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk"/>
Aug 09 22:53:37 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:53:37 user nova-compute[72409]:     </disk>
Aug 09 22:53:37 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:53:37 user nova-compute[72409]:       <mac address="fa:16:3e:71:83:eb"/>
Aug 09 22:53:37 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:53:37 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:53:37 user nova-compute[72409]:       <target dev="tapd2fcb0c2-e9"/>
Aug 09 22:53:37 user nova-compute[72409]:     </interface>
Aug 09 22:53:37 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:53:37 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/console.log" append="off"/>
Aug 09 22:53:37 user nova-compute[72409]:     </serial>
Aug 09 22:53:37 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:53:37 user nova-compute[72409]:     <video>
Aug 09 22:53:37 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:53:37 user nova-compute[72409]:     </video>
Aug 09 22:53:37 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:53:37 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:53:37 user nova-compute[72409]:     </rng>
Aug 09 22:53:37 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:53:37 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:53:37 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:53:37 user nova-compute[72409]:     </memballoon>
Aug 09 22:53:37 user nova-compute[72409]:   </devices>
Aug 09 22:53:37 user nova-compute[72409]: </domain>
Aug 09 22:53:37 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-623150734',display_name='tempest-VolumesAdminNegativeTest-server-623150734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-623150734',id=13,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3700dd59a4548ca8e2ec8dd02ecc6a7',ramdisk_id='',reservation_id='r-4qvzlmvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-994899237',owner_user_name='tempest-VolumesAdminNegativeTest-994899237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:53:35Z,user_data=None,user_id='5567e41fceda4b8abf8d8d56a8bab9b2',uuid=1f17088d-95df-44c9-aac2-24eced6fde25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "address": "fa:16:3e:71:83:eb", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fcb0c2-e9", "ovs_interfaceid": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Converting VIF {"id": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "address": "fa:16:3e:71:83:eb", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fcb0c2-e9", "ovs_interfaceid": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:83:eb,bridge_name='br-int',has_traffic_filtering=True,id=d2fcb0c2-e923-4f89-9911-c76e982dd729,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fcb0c2-e9') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG os_vif [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:83:eb,bridge_name='br-int',has_traffic_filtering=True,id=d2fcb0c2-e923-4f89-9911-c76e982dd729,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fcb0c2-e9') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2fcb0c2-e9, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2fcb0c2-e9, col_values=(('external_ids', {'iface-id': 'd2fcb0c2-e923-4f89-9911-c76e982dd729', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:83:eb', 'vm-uuid': '1f17088d-95df-44c9-aac2-24eced6fde25'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:37 user nova-compute[72409]: INFO os_vif [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:83:eb,bridge_name='br-int',has_traffic_filtering=True,id=d2fcb0c2-e923-4f89-9911-c76e982dd729,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fcb0c2-e9')
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] No VIF found with MAC fa:16:3e:71:83:eb, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.network.neutron [req-276df821-ff87-48ee-b593-c03d59d4f762 req-4832c67f-54c2-4e19-9520-4bffbc82b9e2 service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Updated VIF entry in instance network info cache for port d2fcb0c2-e923-4f89-9911-c76e982dd729. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG nova.network.neutron [req-276df821-ff87-48ee-b593-c03d59d4f762 req-4832c67f-54c2-4e19-9520-4bffbc82b9e2 service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Updating instance_info_cache with network_info: [{"id": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "address": "fa:16:3e:71:83:eb", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fcb0c2-e9", "ovs_interfaceid": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-276df821-ff87-48ee-b593-c03d59d4f762 req-4832c67f-54c2-4e19-9520-4bffbc82b9e2 service nova] Releasing lock "refresh_cache-1f17088d-95df-44c9-aac2-24eced6fde25" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:53:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-d2dd185a-cf9b-4455-b535-f1582697a01f req-b8728225-26a6-4b61-965f-8753471d622a service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Received event network-vif-plugged-d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d2dd185a-cf9b-4455-b535-f1582697a01f req-b8728225-26a6-4b61-965f-8753471d622a service nova] Acquiring lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d2dd185a-cf9b-4455-b535-f1582697a01f req-b8728225-26a6-4b61-965f-8753471d622a service nova] Lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d2dd185a-cf9b-4455-b535-f1582697a01f req-b8728225-26a6-4b61-965f-8753471d622a service nova] Lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-d2dd185a-cf9b-4455-b535-f1582697a01f req-b8728225-26a6-4b61-965f-8753471d622a service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] No waiting events found dispatching network-vif-plugged-d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:39 user nova-compute[72409]: WARNING nova.compute.manager [req-d2dd185a-cf9b-4455-b535-f1582697a01f req-b8728225-26a6-4b61-965f-8753471d622a service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Received unexpected event network-vif-plugged-d2fcb0c2-e923-4f89-9911-c76e982dd729 for instance with vm_state building and task_state spawning.
Aug 09 22:53:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:40 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621605.974305, bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:53:40 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] VM Stopped (Lifecycle Event)
Aug 09 22:53:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8b285333-89ef-4966-94df-5c3703485b93 None None] [instance: bfa1b34b-0d6f-4843-ba25-c54e0aee0f8c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-25cdef46-1ded-41ae-ae6b-ac60c5e54727 req-60a8e2bb-2387-44a2-b704-224fc43a63fe service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Received event network-vif-plugged-d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-25cdef46-1ded-41ae-ae6b-ac60c5e54727 req-60a8e2bb-2387-44a2-b704-224fc43a63fe service nova] Acquiring lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-25cdef46-1ded-41ae-ae6b-ac60c5e54727 req-60a8e2bb-2387-44a2-b704-224fc43a63fe service nova] Lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-25cdef46-1ded-41ae-ae6b-ac60c5e54727 req-60a8e2bb-2387-44a2-b704-224fc43a63fe service nova] Lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-25cdef46-1ded-41ae-ae6b-ac60c5e54727 req-60a8e2bb-2387-44a2-b704-224fc43a63fe service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] No waiting events found dispatching network-vif-plugged-d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:41 user nova-compute[72409]: WARNING nova.compute.manager [req-25cdef46-1ded-41ae-ae6b-ac60c5e54727 req-60a8e2bb-2387-44a2-b704-224fc43a63fe service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Received unexpected event network-vif-plugged-d2fcb0c2-e923-4f89-9911-c76e982dd729 for instance with vm_state building and task_state spawning.
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621621.318276, 1f17088d-95df-44c9-aac2-24eced6fde25 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:53:41 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] VM Resumed (Lifecycle Event)
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:53:41 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Instance spawned successfully.
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:41 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621621.3219132, 1f17088d-95df-44c9-aac2-24eced6fde25 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:53:41 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] VM Started (Lifecycle Event)
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:53:41 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:53:41 user nova-compute[72409]: INFO nova.compute.manager [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Took 6.33 seconds to spawn the instance on the hypervisor.
Aug 09 22:53:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:41 user nova-compute[72409]: INFO nova.compute.manager [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Took 7.13 seconds to build instance.
Aug 09 22:53:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-decf003a-e568-4989-8d2b-22d609acf29b tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "1f17088d-95df-44c9-aac2-24eced6fde25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.290s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "5b7906a3-e02b-49a3-9a56-fc34a8730238" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:53:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:44 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:53:44 user nova-compute[72409]: INFO nova.compute.claims [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Claim successful on node user
Aug 09 22:53:45 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:53:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:53:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG nova.policy [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bf771a74e994703bd1ed49add72cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dfbbb5a1d134adba458e9c592f6fada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:53:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Creating image(s)
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "/opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "/opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.186s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.070s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.173s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk 1073741824" returned: 0 in 0.063s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.157s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:46 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:53:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:46 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Cannot resize image /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:53:46 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'migration_context' on Instance uuid 5b7906a3-e02b-49a3-9a56-fc34a8730238 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:53:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:53:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Ensure instance console log exists: /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:53:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:47 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Successfully created port: a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:53:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:48 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Successfully updated port: a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:53:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "refresh_cache-5b7906a3-e02b-49a3-9a56-fc34a8730238" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:53:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquired lock "refresh_cache-5b7906a3-e02b-49a3-9a56-fc34a8730238" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:53:48 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:53:48 user nova-compute[72409]: DEBUG nova.compute.manager [req-342404d1-d267-4d5b-b68d-2a3fce61bb8b req-421a73f3-79d7-4e45-bc0b-00cf1dfe283e service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Received event network-changed-a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:48 user nova-compute[72409]: DEBUG nova.compute.manager [req-342404d1-d267-4d5b-b68d-2a3fce61bb8b req-421a73f3-79d7-4e45-bc0b-00cf1dfe283e service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Refreshing instance network info cache due to event network-changed-a3239f85-cc45-49f5-97a6-b936267579a8. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:53:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-342404d1-d267-4d5b-b68d-2a3fce61bb8b req-421a73f3-79d7-4e45-bc0b-00cf1dfe283e service nova] Acquiring lock "refresh_cache-5b7906a3-e02b-49a3-9a56-fc34a8730238" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:53:48 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Updating instance_info_cache with network_info: [{"id": "a3239f85-cc45-49f5-97a6-b936267579a8", "address": "fa:16:3e:00:16:76", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3239f85-cc", "ovs_interfaceid": "a3239f85-cc45-49f5-97a6-b936267579a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Releasing lock "refresh_cache-5b7906a3-e02b-49a3-9a56-fc34a8730238" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Instance network_info: |[{"id": "a3239f85-cc45-49f5-97a6-b936267579a8", "address": "fa:16:3e:00:16:76", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3239f85-cc", "ovs_interfaceid": "a3239f85-cc45-49f5-97a6-b936267579a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-342404d1-d267-4d5b-b68d-2a3fce61bb8b req-421a73f3-79d7-4e45-bc0b-00cf1dfe283e service nova] Acquired lock "refresh_cache-5b7906a3-e02b-49a3-9a56-fc34a8730238" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.network.neutron [req-342404d1-d267-4d5b-b68d-2a3fce61bb8b req-421a73f3-79d7-4e45-bc0b-00cf1dfe283e service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Refreshing network info cache for port a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Start _get_guest_xml network_info=[{"id": "a3239f85-cc45-49f5-97a6-b936267579a8", "address": "fa:16:3e:00:16:76", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3239f85-cc", "ovs_interfaceid": "a3239f85-cc45-49f5-97a6-b936267579a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:53:49 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:53:49 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-263758231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-263758231',id=14,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dfbbb5a1d134adba458e9c592f6fada',ramdisk_id='',reservation_id='r-kp0kahcr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-426575742',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:53:45Z,user_data=None,user_id='8bf771a74e994703bd1ed49add72cd14',uuid=5b7906a3-e02b-49a3-9a56-fc34a8730238,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3239f85-cc45-49f5-97a6-b936267579a8", "address": "fa:16:3e:00:16:76", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3239f85-cc", "ovs_interfaceid": "a3239f85-cc45-49f5-97a6-b936267579a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converting VIF {"id": "a3239f85-cc45-49f5-97a6-b936267579a8", "address": "fa:16:3e:00:16:76", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3239f85-cc", "ovs_interfaceid": "a3239f85-cc45-49f5-97a6-b936267579a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:16:76,bridge_name='br-int',has_traffic_filtering=True,id=a3239f85-cc45-49f5-97a6-b936267579a8,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3239f85-cc') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b7906a3-e02b-49a3-9a56-fc34a8730238 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:53:49 user nova-compute[72409]:   <uuid>5b7906a3-e02b-49a3-9a56-fc34a8730238</uuid>
Aug 09 22:53:49 user nova-compute[72409]:   <name>instance-0000000e</name>
Aug 09 22:53:49 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:53:49 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:53:49 user nova-compute[72409]:   <metadata>
Aug 09 22:53:49 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:53:49 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:53:49 user nova-compute[72409]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-263758231</nova:name>
Aug 09 22:53:49 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:53:49</nova:creationTime>
Aug 09 22:53:49 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:53:49 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:53:49 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:53:49 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:53:49 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:53:49 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:53:49 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:53:49 user nova-compute[72409]:       <nova:owner>
Aug 09 22:53:49 user nova-compute[72409]:         <nova:user uuid="8bf771a74e994703bd1ed49add72cd14">tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member</nova:user>
Aug 09 22:53:49 user nova-compute[72409]:         <nova:project uuid="7dfbbb5a1d134adba458e9c592f6fada">tempest-ServerBootFromVolumeStableRescueTest-426575742</nova:project>
Aug 09 22:53:49 user nova-compute[72409]:       </nova:owner>
Aug 09 22:53:49 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:53:49 user nova-compute[72409]:       <nova:ports>
Aug 09 22:53:49 user nova-compute[72409]:         <nova:port uuid="a3239f85-cc45-49f5-97a6-b936267579a8">
Aug 09 22:53:49 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 22:53:49 user nova-compute[72409]:         </nova:port>
Aug 09 22:53:49 user nova-compute[72409]:       </nova:ports>
Aug 09 22:53:49 user nova-compute[72409]:     </nova:instance>
Aug 09 22:53:49 user nova-compute[72409]:   </metadata>
Aug 09 22:53:49 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:53:49 user nova-compute[72409]:     <system>
Aug 09 22:53:49 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:53:49 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:53:49 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:53:49 user nova-compute[72409]:       <entry name="serial">5b7906a3-e02b-49a3-9a56-fc34a8730238</entry>
Aug 09 22:53:49 user nova-compute[72409]:       <entry name="uuid">5b7906a3-e02b-49a3-9a56-fc34a8730238</entry>
Aug 09 22:53:49 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:53:49 user nova-compute[72409]:     </system>
Aug 09 22:53:49 user nova-compute[72409]:   </sysinfo>
Aug 09 22:53:49 user nova-compute[72409]:   <os>
Aug 09 22:53:49 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:53:49 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:53:49 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:53:49 user nova-compute[72409]:   </os>
Aug 09 22:53:49 user nova-compute[72409]:   <features>
Aug 09 22:53:49 user nova-compute[72409]:     <acpi/>
Aug 09 22:53:49 user nova-compute[72409]:     <apic/>
Aug 09 22:53:49 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:53:49 user nova-compute[72409]:   </features>
Aug 09 22:53:49 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:53:49 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:53:49 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:53:49 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:53:49 user nova-compute[72409]:   </clock>
Aug 09 22:53:49 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:53:49 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:53:49 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:53:49 user nova-compute[72409]:   </cpu>
Aug 09 22:53:49 user nova-compute[72409]:   <devices>
Aug 09 22:53:49 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:53:49 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:53:49 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk"/>
Aug 09 22:53:49 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:53:49 user nova-compute[72409]:     </disk>
Aug 09 22:53:49 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:53:49 user nova-compute[72409]:       <mac address="fa:16:3e:00:16:76"/>
Aug 09 22:53:49 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:53:49 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:53:49 user nova-compute[72409]:       <target dev="tapa3239f85-cc"/>
Aug 09 22:53:49 user nova-compute[72409]:     </interface>
Aug 09 22:53:49 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:53:49 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/console.log" append="off"/>
Aug 09 22:53:49 user nova-compute[72409]:     </serial>
Aug 09 22:53:49 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:53:49 user nova-compute[72409]:     <video>
Aug 09 22:53:49 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:53:49 user nova-compute[72409]:     </video>
Aug 09 22:53:49 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:53:49 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:53:49 user nova-compute[72409]:     </rng>
Aug 09 22:53:49 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:53:49 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:53:49 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:53:49 user nova-compute[72409]:     </memballoon>
Aug 09 22:53:49 user nova-compute[72409]:   </devices>
Aug 09 22:53:49 user nova-compute[72409]: </domain>
Aug 09 22:53:49 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-263758231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-263758231',id=14,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dfbbb5a1d134adba458e9c592f6fada',ramdisk_id='',reservation_id='r-kp0kahcr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-426575742',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:53:45Z,user_data=None,user_id='8bf771a74e994703bd1ed49add72cd14',uuid=5b7906a3-e02b-49a3-9a56-fc34a8730238,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3239f85-cc45-49f5-97a6-b936267579a8", "address": "fa:16:3e:00:16:76", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3239f85-cc", "ovs_interfaceid": "a3239f85-cc45-49f5-97a6-b936267579a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converting VIF {"id": "a3239f85-cc45-49f5-97a6-b936267579a8", "address": "fa:16:3e:00:16:76", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3239f85-cc", "ovs_interfaceid": "a3239f85-cc45-49f5-97a6-b936267579a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:16:76,bridge_name='br-int',has_traffic_filtering=True,id=a3239f85-cc45-49f5-97a6-b936267579a8,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3239f85-cc') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG os_vif [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:16:76,bridge_name='br-int',has_traffic_filtering=True,id=a3239f85-cc45-49f5-97a6-b936267579a8,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3239f85-cc') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3239f85-cc, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3239f85-cc, col_values=(('external_ids', {'iface-id': 'a3239f85-cc45-49f5-97a6-b936267579a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:16:76', 'vm-uuid': '5b7906a3-e02b-49a3-9a56-fc34a8730238'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:49 user nova-compute[72409]: INFO os_vif [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:16:76,bridge_name='br-int',has_traffic_filtering=True,id=a3239f85-cc45-49f5-97a6-b936267579a8,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3239f85-cc')
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] No VIF found with MAC fa:16:3e:00:16:76, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:49 user nova-compute[72409]: INFO nova.compute.manager [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Terminating instance
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.network.neutron [req-342404d1-d267-4d5b-b68d-2a3fce61bb8b req-421a73f3-79d7-4e45-bc0b-00cf1dfe283e service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Updated VIF entry in instance network info cache for port a3239f85-cc45-49f5-97a6-b936267579a8. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.network.neutron [req-342404d1-d267-4d5b-b68d-2a3fce61bb8b req-421a73f3-79d7-4e45-bc0b-00cf1dfe283e service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Updating instance_info_cache with network_info: [{"id": "a3239f85-cc45-49f5-97a6-b936267579a8", "address": "fa:16:3e:00:16:76", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3239f85-cc", "ovs_interfaceid": "a3239f85-cc45-49f5-97a6-b936267579a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-342404d1-d267-4d5b-b68d-2a3fce61bb8b req-421a73f3-79d7-4e45-bc0b-00cf1dfe283e service nova] Releasing lock "refresh_cache-5b7906a3-e02b-49a3-9a56-fc34a8730238" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Skipping network cache update for instance because it is being deleted. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 09 22:53:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:53:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:53:50 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 22:53:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-9e3e2545-6e71-43c7-9221-7689b20f6a7e req-14a3dae4-eca7-4fb5-9142-9b115c32a842 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-vif-unplugged-8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9e3e2545-6e71-43c7-9221-7689b20f6a7e req-14a3dae4-eca7-4fb5-9142-9b115c32a842 service nova] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9e3e2545-6e71-43c7-9221-7689b20f6a7e req-14a3dae4-eca7-4fb5-9142-9b115c32a842 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9e3e2545-6e71-43c7-9221-7689b20f6a7e req-14a3dae4-eca7-4fb5-9142-9b115c32a842 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-9e3e2545-6e71-43c7-9221-7689b20f6a7e req-14a3dae4-eca7-4fb5-9142-9b115c32a842 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] No waiting events found dispatching network-vif-unplugged-8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-9e3e2545-6e71-43c7-9221-7689b20f6a7e req-14a3dae4-eca7-4fb5-9142-9b115c32a842 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-vif-unplugged-8c4beea2-41b0-4bf4-be54-170aa75d060a for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:53:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:50 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Updating instance_info_cache with network_info: [{"id": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "address": "fa:16:3e:d7:57:ed", "network": {"id": "9bc6437a-445d-4bd1-8fd5-56e4d64fc45e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1499918820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bd4aed4e4c43cb9e3096f4f3757776", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a0bdd7-ce", "ovs_interfaceid": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Instance destroyed successfully.
Aug 09 22:53:51 user nova-compute[72409]: DEBUG nova.objects.instance [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lazy-loading 'resources' on Instance uuid 7297de80-2674-4d9e-88e7-7a809bcf7381 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-850058011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-850058011',id=7,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRPOKUNKx5r99nfeKMhpfm/VZ7AykvwNHlx19s63HAGjMBCMer6PwKksiSdO/uCgcrPPCs4Mdvnww76K8FCrlZ8SSpOgbs2r8XIKgBv2t3yYVeYOMw4Yjg1wzdcpPxGXQ==',key_name='tempest-keypair-1164357353',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5ab01b4b8ef44a3b303aca035f69503',ramdisk_id='',reservation_id='r-mufx0for',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-12735973',owner_user_name='tempest-TaggedAttachmentsTest-12735973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='25c4618cd6154fc6a3205d0b42f5a0f4',uuid=7297de80-2674-4d9e-88e7-7a809bcf7381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converting VIF {"id": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "address": "fa:16:3e:1b:38:d8", "network": {"id": "5800b5ee-380b-46ff-83a8-ac91596f1efb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1189518185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ab01b4b8ef44a3b303aca035f69503", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c4beea2-41", "ovs_interfaceid": "8c4beea2-41b0-4bf4-be54-170aa75d060a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:38:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c4beea2-41b0-4bf4-be54-170aa75d060a,network=Network(5800b5ee-380b-46ff-83a8-ac91596f1efb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4beea2-41') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG os_vif [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:38:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c4beea2-41b0-4bf4-be54-170aa75d060a,network=Network(5800b5ee-380b-46ff-83a8-ac91596f1efb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4beea2-41') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c4beea2-41, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:53:51 user nova-compute[72409]: INFO os_vif [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:38:d8,bridge_name='br-int',has_traffic_filtering=True,id=8c4beea2-41b0-4bf4-be54-170aa75d060a,network=Network(5800b5ee-380b-46ff-83a8-ac91596f1efb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c4beea2-41')
Aug 09 22:53:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Deleting instance files /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381_del
Aug 09 22:53:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Deletion of /opt/stack/data/nova/instances/7297de80-2674-4d9e-88e7-7a809bcf7381_del complete
Aug 09 22:53:51 user nova-compute[72409]: INFO nova.compute.manager [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Took 1.66 seconds to destroy the instance on the hypervisor.
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-a25054a0-a185-4a47-bb9d-829611dd6a1a req-fa252aff-6280-4e75-b06e-97d6446abcb9 service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Received event network-vif-plugged-a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a25054a0-a185-4a47-bb9d-829611dd6a1a req-fa252aff-6280-4e75-b06e-97d6446abcb9 service nova] Acquiring lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a25054a0-a185-4a47-bb9d-829611dd6a1a req-fa252aff-6280-4e75-b06e-97d6446abcb9 service nova] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a25054a0-a185-4a47-bb9d-829611dd6a1a req-fa252aff-6280-4e75-b06e-97d6446abcb9 service nova] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-a25054a0-a185-4a47-bb9d-829611dd6a1a req-fa252aff-6280-4e75-b06e-97d6446abcb9 service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] No waiting events found dispatching network-vif-plugged-a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:51 user nova-compute[72409]: WARNING nova.compute.manager [req-a25054a0-a185-4a47-bb9d-829611dd6a1a req-fa252aff-6280-4e75-b06e-97d6446abcb9 service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Received unexpected event network-vif-plugged-a3239f85-cc45-49f5-97a6-b936267579a8 for instance with vm_state building and task_state spawning.
Aug 09 22:53:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-cc9cac23-aeec-4554-8a99-690be5cf431e req-714243f2-eaf5-4113-914c-6486405f25b7 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-vif-plugged-8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cc9cac23-aeec-4554-8a99-690be5cf431e req-714243f2-eaf5-4113-914c-6486405f25b7 service nova] Acquiring lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cc9cac23-aeec-4554-8a99-690be5cf431e req-714243f2-eaf5-4113-914c-6486405f25b7 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cc9cac23-aeec-4554-8a99-690be5cf431e req-714243f2-eaf5-4113-914c-6486405f25b7 service nova] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-cc9cac23-aeec-4554-8a99-690be5cf431e req-714243f2-eaf5-4113-914c-6486405f25b7 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] No waiting events found dispatching network-vif-plugged-8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:52 user nova-compute[72409]: WARNING nova.compute.manager [req-cc9cac23-aeec-4554-8a99-690be5cf431e req-714243f2-eaf5-4113-914c-6486405f25b7 service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received unexpected event network-vif-plugged-8c4beea2-41b0-4bf4-be54-170aa75d060a for instance with vm_state active and task_state deleting.
Aug 09 22:53:52 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:53:53 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Took 1.95 seconds to deallocate network for instance.
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621633.7629414, 5b7906a3-e02b-49a3-9a56-fc34a8730238 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:53:53 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] VM Resumed (Lifecycle Event)
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:53:53 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Instance spawned successfully.
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.compute.manager [req-1ad56b80-7215-4ac3-ae0f-4ce597480765 req-aafd4311-3c07-4247-a71c-22a232e6ac7c service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Received event network-vif-plugged-a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1ad56b80-7215-4ac3-ae0f-4ce597480765 req-aafd4311-3c07-4247-a71c-22a232e6ac7c service nova] Acquiring lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1ad56b80-7215-4ac3-ae0f-4ce597480765 req-aafd4311-3c07-4247-a71c-22a232e6ac7c service nova] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1ad56b80-7215-4ac3-ae0f-4ce597480765 req-aafd4311-3c07-4247-a71c-22a232e6ac7c service nova] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.compute.manager [req-1ad56b80-7215-4ac3-ae0f-4ce597480765 req-aafd4311-3c07-4247-a71c-22a232e6ac7c service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] No waiting events found dispatching network-vif-plugged-a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:53:53 user nova-compute[72409]: WARNING nova.compute.manager [req-1ad56b80-7215-4ac3-ae0f-4ce597480765 req-aafd4311-3c07-4247-a71c-22a232e6ac7c service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Received unexpected event network-vif-plugged-a3239f85-cc45-49f5-97a6-b936267579a8 for instance with vm_state building and task_state spawning.
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.compute.manager [req-1ad56b80-7215-4ac3-ae0f-4ce597480765 req-aafd4311-3c07-4247-a71c-22a232e6ac7c service nova] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Received event network-vif-deleted-8c4beea2-41b0-4bf4-be54-170aa75d060a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:53 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621633.7657495, 5b7906a3-e02b-49a3-9a56-fc34a8730238 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:53:53 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] VM Started (Lifecycle Event)
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:53:54 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:53:54 user nova-compute[72409]: INFO nova.compute.manager [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Took 9.10 seconds to spawn the instance on the hypervisor.
Aug 09 22:53:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:53:54 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:53:54 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:53:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7958MB free_disk=25.74753189086914GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.130s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.085s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:54 user nova-compute[72409]: INFO nova.compute.manager [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Took 9.94 seconds to build instance.
Aug 09 22:53:54 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Deleted allocations for instance 7297de80-2674-4d9e-88e7-7a809bcf7381
Aug 09 22:53:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2361a2ec-7f1f-4645-93f6-dc22079462f5 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.174s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5af7f4c7-5937-4b69-831e-941d7de4417d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 29a04807-1c46-4546-b78c-73d4f2b86c46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 1f17088d-95df-44c9-aac2-24eced6fde25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5b7906a3-e02b-49a3-9a56-fc34a8730238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71f789fb-de3e-42be-9768-1eb502808231 tempest-TaggedAttachmentsTest-12735973 tempest-TaggedAttachmentsTest-12735973-project-member] Lock "7297de80-2674-4d9e-88e7-7a809bcf7381" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.122s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:54 user nova-compute[72409]: INFO nova.compute.manager [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Unshelving
Aug 09 22:53:55 user nova-compute[72409]: INFO nova.virt.block_device [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Booting with volume afc3b053-5a66-420c-8b7a-e33094cb2125 at /dev/vdc
Aug 09 22:53:55 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG os_brick.utils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ee1d0d-d74c-46a1-9091-91ca1840ce0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f04ee0-764c-470e-bb31-39f039ac5f38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceb9703-2edc-4767-b4f6-948524503b70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4552297b-bf01-47f5-ab27-55641f0ca292]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:53:55 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:53:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1439b5b-4927-4fe2-91a5-91e5ffa95fa6]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG os_brick.utils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:53:55 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updating existing volume attachment record: 0946406a-946b-4dfd-8f0d-78c2aa85ad27 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:53:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:53:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:53:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:53:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:54:00 user nova-compute[72409]: INFO nova.compute.claims [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Claim successful on node user
Aug 09 22:54:00 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:54:00 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:54:00 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:54:00 user nova-compute[72409]: INFO nova.virt.block_device [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Booting with volume c7d8d350-15a0-4271-9b13-f063e5b7e68a at /dev/vda
Aug 09 22:54:00 user nova-compute[72409]: DEBUG os_brick.utils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG nova.policy [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd18abb14d08141a487b3bd0f51333be8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc4cb0f78e64f8ea5b40bb6d20cc107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff477cf6-183f-4b3d-ad3b-d274bb2f4c28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[40370bd6-977b-4a1c-be2c-0eb72b947f03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e86eb0d-ed00-4676-b41b-ec5cd208d673]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d5b3a5-e159-492c-b3c1-f162d6f5712c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:54:00 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:54:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcc2a02-5695-42d4-bc28-6790747fce46]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG os_brick.utils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:54:00 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating existing volume attachment record: 51970fdf-0cb0-4c27-a75a-09c23abd9527 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:54:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:01 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Successfully created port: c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:54:02 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Successfully created port: d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:54:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:03 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Successfully created port: 596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:54:05 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Successfully created port: 49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:54:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:06 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621631.3025057, 7297de80-2674-4d9e-88e7-7a809bcf7381 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:54:06 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] VM Stopped (Lifecycle Event)
Aug 09 22:54:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d1ef5723-9162-472b-88cd-e288076e4576 None None] [instance: 7297de80-2674-4d9e-88e7-7a809bcf7381] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:06 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Successfully created port: 117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:54:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:07 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Successfully updated port: c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:54:07 user nova-compute[72409]: DEBUG nova.compute.manager [req-8ac787fa-2fb0-415e-9603-77b3517a6dba req-66a15c13-fb24-402d-8153-65020bd2d691 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-changed-c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:07 user nova-compute[72409]: DEBUG nova.compute.manager [req-8ac787fa-2fb0-415e-9603-77b3517a6dba req-66a15c13-fb24-402d-8153-65020bd2d691 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing instance network info cache due to event network-changed-c14ceb07-7e71-4723-88ff-482f29035aa0. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:54:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8ac787fa-2fb0-415e-9603-77b3517a6dba req-66a15c13-fb24-402d-8153-65020bd2d691 service nova] Acquiring lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8ac787fa-2fb0-415e-9603-77b3517a6dba req-66a15c13-fb24-402d-8153-65020bd2d691 service nova] Acquired lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:07 user nova-compute[72409]: DEBUG nova.network.neutron [req-8ac787fa-2fb0-415e-9603-77b3517a6dba req-66a15c13-fb24-402d-8153-65020bd2d691 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing network info cache for port c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:54:07 user nova-compute[72409]: DEBUG nova.network.neutron [req-8ac787fa-2fb0-415e-9603-77b3517a6dba req-66a15c13-fb24-402d-8153-65020bd2d691 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:54:08 user nova-compute[72409]: DEBUG nova.network.neutron [req-8ac787fa-2fb0-415e-9603-77b3517a6dba req-66a15c13-fb24-402d-8153-65020bd2d691 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8ac787fa-2fb0-415e-9603-77b3517a6dba req-66a15c13-fb24-402d-8153-65020bd2d691 service nova] Releasing lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:09 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Successfully updated port: 5da1a50d-d954-4558-ab6a-334eb3986c37 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:54:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-723b9486-796a-4fb3-8c59-ec7a31ca237e req-c45a0886-2660-4746-970d-787e77615474 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-changed-5da1a50d-d954-4558-ab6a-334eb3986c37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-723b9486-796a-4fb3-8c59-ec7a31ca237e req-c45a0886-2660-4746-970d-787e77615474 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing instance network info cache due to event network-changed-5da1a50d-d954-4558-ab6a-334eb3986c37. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:54:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-723b9486-796a-4fb3-8c59-ec7a31ca237e req-c45a0886-2660-4746-970d-787e77615474 service nova] Acquiring lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-723b9486-796a-4fb3-8c59-ec7a31ca237e req-c45a0886-2660-4746-970d-787e77615474 service nova] Acquired lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:09 user nova-compute[72409]: DEBUG nova.network.neutron [req-723b9486-796a-4fb3-8c59-ec7a31ca237e req-c45a0886-2660-4746-970d-787e77615474 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing network info cache for port 5da1a50d-d954-4558-ab6a-334eb3986c37 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:54:09 user nova-compute[72409]: DEBUG nova.network.neutron [req-723b9486-796a-4fb3-8c59-ec7a31ca237e req-c45a0886-2660-4746-970d-787e77615474 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:54:10 user nova-compute[72409]: DEBUG nova.network.neutron [req-723b9486-796a-4fb3-8c59-ec7a31ca237e req-c45a0886-2660-4746-970d-787e77615474 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-723b9486-796a-4fb3-8c59-ec7a31ca237e req-c45a0886-2660-4746-970d-787e77615474 service nova] Releasing lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Successfully updated port: c7073d80-257f-4127-823e-13f02e3997e3 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "3f216945-199d-4047-8bc8-407d5842c536" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:11 user nova-compute[72409]: INFO nova.virt.block_device [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Booting with volume 99d4523c-9193-4225-a542-03bab1455a56 at /dev/vdb
Aug 09 22:54:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:54:11 user nova-compute[72409]: INFO nova.compute.claims [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Claim successful on node user
Aug 09 22:54:11 user nova-compute[72409]: DEBUG os_brick.utils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47f7338-7bfa-4db6-9cd0-84f05897f354]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[82556b49-b9ae-42df-a9cb-848e5aea3bc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[65247b2b-bb63-4cec-93f4-8de51d34b358]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53c8eea-a00b-4047-850c-3b4892535b84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:54:11 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e536af-60e3-442f-a68d-c4463b4c784d]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG os_brick.utils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating existing volume attachment record: e7666532-ae32-425a-bfa1-65c1862b6702 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Successfully updated port: d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-changed-c7073d80-257f-4127-823e-13f02e3997e3 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing instance network info cache due to event network-changed-c7073d80-257f-4127-823e-13f02e3997e3. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] Acquiring lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] Acquired lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG nova.network.neutron [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing network info cache for port c7073d80-257f-4127-823e-13f02e3997e3 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.754s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:54:11 user nova-compute[72409]: DEBUG nova.network.neutron [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.network.neutron [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:54:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:54:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Creating image(s)
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "/opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "/opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.network.neutron [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] Releasing lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-changed-d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing instance network info cache due to event network-changed-d0512c07-7c8a-4e50-8a26-218871739981. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] Acquiring lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] Acquired lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.network.neutron [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing network info cache for port d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.network.neutron [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.policy [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efd76f1c0d9b42269fcc69f24c9f59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7e3f592e7141659581ae7f67c6af43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk 1073741824" returned: 0 in 0.083s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.network.neutron [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5dd9387a-45b7-4c4f-af8b-9990d1da4817 req-cbc54710-f8c5-4a71-a12f-6265b197cda1 service nova] Releasing lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Cannot resize image /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.objects.instance [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'migration_context' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Ensure instance console log exists: /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:13 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Successfully updated port: 596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:54:13 user nova-compute[72409]: DEBUG nova.network.neutron [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Successfully created port: 410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:54:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:13 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'pci_requests' on Instance uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-e4c05b78-6659-4ce9-b80e-6964498d6754 req-7cbffe4f-7e26-40c8-88f7-a50e28d4d52d service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-changed-596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-e4c05b78-6659-4ce9-b80e-6964498d6754 req-7cbffe4f-7e26-40c8-88f7-a50e28d4d52d service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing instance network info cache due to event network-changed-596e3df6-8719-490f-8f60-73578c9cf511. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:54:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e4c05b78-6659-4ce9-b80e-6964498d6754 req-7cbffe4f-7e26-40c8-88f7-a50e28d4d52d service nova] Acquiring lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e4c05b78-6659-4ce9-b80e-6964498d6754 req-7cbffe4f-7e26-40c8-88f7-a50e28d4d52d service nova] Acquired lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:13 user nova-compute[72409]: DEBUG nova.network.neutron [req-e4c05b78-6659-4ce9-b80e-6964498d6754 req-7cbffe4f-7e26-40c8-88f7-a50e28d4d52d service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing network info cache for port 596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:54:13 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'numa_topology' on Instance uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:13 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:54:13 user nova-compute[72409]: INFO nova.compute.claims [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Claim successful on node user
Aug 09 22:54:13 user nova-compute[72409]: DEBUG nova.network.neutron [req-e4c05b78-6659-4ce9-b80e-6964498d6754 req-7cbffe4f-7e26-40c8-88f7-a50e28d4d52d service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Successfully updated port: 49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.network.neutron [req-e4c05b78-6659-4ce9-b80e-6964498d6754 req-7cbffe4f-7e26-40c8-88f7-a50e28d4d52d service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e4c05b78-6659-4ce9-b80e-6964498d6754 req-7cbffe4f-7e26-40c8-88f7-a50e28d4d52d service nova] Releasing lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Successfully updated port: 410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquired lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-7c02b09d-4ba2-4240-86b8-92e5c9c1dbc7 req-3c350be5-b205-44c0-a757-69b3baafeff8 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-changed-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-7c02b09d-4ba2-4240-86b8-92e5c9c1dbc7 req-3c350be5-b205-44c0-a757-69b3baafeff8 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Refreshing instance network info cache due to event network-changed-410a93bc-9f2d-473e-acfb-bf171c4bcf4a. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7c02b09d-4ba2-4240-86b8-92e5c9c1dbc7 req-3c350be5-b205-44c0-a757-69b3baafeff8 service nova] Acquiring lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:54:14 user nova-compute[72409]: INFO nova.network.neutron [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updating port 073bad5c-1f38-4fb0-b4e9-803dd62fcd34 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updating instance_info_cache with network_info: [{"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Releasing lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.compute.manager [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Instance network_info: |[{"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7c02b09d-4ba2-4240-86b8-92e5c9c1dbc7 req-3c350be5-b205-44c0-a757-69b3baafeff8 service nova] Acquired lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.network.neutron [req-7c02b09d-4ba2-4240-86b8-92e5c9c1dbc7 req-3c350be5-b205-44c0-a757-69b3baafeff8 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Refreshing network info cache for port 410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Start _get_guest_xml network_info=[{"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:54:14 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:54:14 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-869366492',display_name='tempest-ServerActionsTestOtherA-server-869366492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-869366492',id=16,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzHC0syLklL8GtXvz6DwLHZAI3KijCzzG+c3H7vbfCfvBbdLu31zQrL5KQv6qO6LPapTOC2Zi0KeYbsTlIE+6d9oW1MPV8oBMrDCQEY9sL1aQ71vDiQHBGpACA1bJ0plQ==',key_name='tempest-keypair-183406528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7e3f592e7141659581ae7f67c6af43',ramdisk_id='',reservation_id='r-sst2ny3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-640999933',owner_user_name='tempest-ServerActionsTestOtherA-640999933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd76f1c0d9b42269fcc69f24c9f59e6',uuid=3f216945-199d-4047-8bc8-407d5842c536,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converting VIF {"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:54:14 user nova-compute[72409]:   <uuid>3f216945-199d-4047-8bc8-407d5842c536</uuid>
Aug 09 22:54:14 user nova-compute[72409]:   <name>instance-00000010</name>
Aug 09 22:54:14 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:54:14 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:54:14 user nova-compute[72409]:   <metadata>
Aug 09 22:54:14 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:54:14 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:54:14 user nova-compute[72409]:       <nova:name>tempest-ServerActionsTestOtherA-server-869366492</nova:name>
Aug 09 22:54:14 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:54:14</nova:creationTime>
Aug 09 22:54:14 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:54:14 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:54:14 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:54:14 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:54:14 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:54:14 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:54:14 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:54:14 user nova-compute[72409]:       <nova:owner>
Aug 09 22:54:14 user nova-compute[72409]:         <nova:user uuid="efd76f1c0d9b42269fcc69f24c9f59e6">tempest-ServerActionsTestOtherA-640999933-project-member</nova:user>
Aug 09 22:54:14 user nova-compute[72409]:         <nova:project uuid="8c7e3f592e7141659581ae7f67c6af43">tempest-ServerActionsTestOtherA-640999933</nova:project>
Aug 09 22:54:14 user nova-compute[72409]:       </nova:owner>
Aug 09 22:54:14 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:54:14 user nova-compute[72409]:       <nova:ports>
Aug 09 22:54:14 user nova-compute[72409]:         <nova:port uuid="410a93bc-9f2d-473e-acfb-bf171c4bcf4a">
Aug 09 22:54:14 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 22:54:14 user nova-compute[72409]:         </nova:port>
Aug 09 22:54:14 user nova-compute[72409]:       </nova:ports>
Aug 09 22:54:14 user nova-compute[72409]:     </nova:instance>
Aug 09 22:54:14 user nova-compute[72409]:   </metadata>
Aug 09 22:54:14 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:54:14 user nova-compute[72409]:     <system>
Aug 09 22:54:14 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:54:14 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:54:14 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:54:14 user nova-compute[72409]:       <entry name="serial">3f216945-199d-4047-8bc8-407d5842c536</entry>
Aug 09 22:54:14 user nova-compute[72409]:       <entry name="uuid">3f216945-199d-4047-8bc8-407d5842c536</entry>
Aug 09 22:54:14 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:54:14 user nova-compute[72409]:     </system>
Aug 09 22:54:14 user nova-compute[72409]:   </sysinfo>
Aug 09 22:54:14 user nova-compute[72409]:   <os>
Aug 09 22:54:14 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:54:14 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:54:14 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:54:14 user nova-compute[72409]:   </os>
Aug 09 22:54:14 user nova-compute[72409]:   <features>
Aug 09 22:54:14 user nova-compute[72409]:     <acpi/>
Aug 09 22:54:14 user nova-compute[72409]:     <apic/>
Aug 09 22:54:14 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:54:14 user nova-compute[72409]:   </features>
Aug 09 22:54:14 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:54:14 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:54:14 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:54:14 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:54:14 user nova-compute[72409]:   </clock>
Aug 09 22:54:14 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:54:14 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:54:14 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:54:14 user nova-compute[72409]:   </cpu>
Aug 09 22:54:14 user nova-compute[72409]:   <devices>
Aug 09 22:54:14 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:54:14 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:54:14 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk"/>
Aug 09 22:54:14 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:54:14 user nova-compute[72409]:     </disk>
Aug 09 22:54:14 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:54:14 user nova-compute[72409]:       <mac address="fa:16:3e:a7:ea:25"/>
Aug 09 22:54:14 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:14 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:54:14 user nova-compute[72409]:       <target dev="tap410a93bc-9f"/>
Aug 09 22:54:14 user nova-compute[72409]:     </interface>
Aug 09 22:54:14 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:54:14 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/console.log" append="off"/>
Aug 09 22:54:14 user nova-compute[72409]:     </serial>
Aug 09 22:54:14 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:54:14 user nova-compute[72409]:     <video>
Aug 09 22:54:14 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:14 user nova-compute[72409]:     </video>
Aug 09 22:54:14 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:54:14 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:54:14 user nova-compute[72409]:     </rng>
Aug 09 22:54:14 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:54:14 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:54:14 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:54:14 user nova-compute[72409]:     </memballoon>
Aug 09 22:54:14 user nova-compute[72409]:   </devices>
Aug 09 22:54:14 user nova-compute[72409]: </domain>
Aug 09 22:54:14 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-869366492',display_name='tempest-ServerActionsTestOtherA-server-869366492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-869366492',id=16,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzHC0syLklL8GtXvz6DwLHZAI3KijCzzG+c3H7vbfCfvBbdLu31zQrL5KQv6qO6LPapTOC2Zi0KeYbsTlIE+6d9oW1MPV8oBMrDCQEY9sL1aQ71vDiQHBGpACA1bJ0plQ==',key_name='tempest-keypair-183406528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7e3f592e7141659581ae7f67c6af43',ramdisk_id='',reservation_id='r-sst2ny3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-640999933',owner_user_name='tempest-ServerActionsTestOtherA-640999933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd76f1c0d9b42269fcc69f24c9f59e6',uuid=3f216945-199d-4047-8bc8-407d5842c536,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converting VIF {"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG os_vif [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap410a93bc-9f, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap410a93bc-9f, col_values=(('external_ids', {'iface-id': '410a93bc-9f2d-473e-acfb-bf171c4bcf4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:ea:25', 'vm-uuid': '3f216945-199d-4047-8bc8-407d5842c536'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:14 user nova-compute[72409]: INFO os_vif [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f')
Aug 09 22:54:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:54:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] No VIF found with MAC fa:16:3e:a7:ea:25, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:54:15 user nova-compute[72409]: DEBUG nova.network.neutron [req-7c02b09d-4ba2-4240-86b8-92e5c9c1dbc7 req-3c350be5-b205-44c0-a757-69b3baafeff8 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updated VIF entry in instance network info cache for port 410a93bc-9f2d-473e-acfb-bf171c4bcf4a. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:54:15 user nova-compute[72409]: DEBUG nova.network.neutron [req-7c02b09d-4ba2-4240-86b8-92e5c9c1dbc7 req-3c350be5-b205-44c0-a757-69b3baafeff8 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updating instance_info_cache with network_info: [{"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7c02b09d-4ba2-4240-86b8-92e5c9c1dbc7 req-3c350be5-b205-44c0-a757-69b3baafeff8 service nova] Releasing lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-aa3d42df-9cbb-493c-b634-9781d28b79cf req-afa1d45e-4817-4dba-9d8b-94f8dc88a14d service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-changed-49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-aa3d42df-9cbb-493c-b634-9781d28b79cf req-afa1d45e-4817-4dba-9d8b-94f8dc88a14d service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing instance network info cache due to event network-changed-49e29e6b-a887-425f-9eca-94a25bdb3301. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:54:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aa3d42df-9cbb-493c-b634-9781d28b79cf req-afa1d45e-4817-4dba-9d8b-94f8dc88a14d service nova] Acquiring lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aa3d42df-9cbb-493c-b634-9781d28b79cf req-afa1d45e-4817-4dba-9d8b-94f8dc88a14d service nova] Acquired lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:15 user nova-compute[72409]: DEBUG nova.network.neutron [req-aa3d42df-9cbb-493c-b634-9781d28b79cf req-afa1d45e-4817-4dba-9d8b-94f8dc88a14d service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing network info cache for port 49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG nova.network.neutron [req-aa3d42df-9cbb-493c-b634-9781d28b79cf req-afa1d45e-4817-4dba-9d8b-94f8dc88a14d service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Successfully updated port: 117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquired lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG nova.network.neutron [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG nova.network.neutron [req-aa3d42df-9cbb-493c-b634-9781d28b79cf req-afa1d45e-4817-4dba-9d8b-94f8dc88a14d service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aa3d42df-9cbb-493c-b634-9781d28b79cf req-afa1d45e-4817-4dba-9d8b-94f8dc88a14d service nova] Releasing lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquired lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:17 user nova-compute[72409]: DEBUG nova.network.neutron [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updating instance_info_cache with network_info: [{"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Releasing lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:54:17 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Creating image(s)
Aug 09 22:54:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "/opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "/opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "/opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:17 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'trusted_certs' on Instance uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "c9b41a037b00a0760715210d453edbe11519921a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "c9b41a037b00a0760715210d453edbe11519921a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a.part --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:18 user nova-compute[72409]: DEBUG nova.compute.manager [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-changed-117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:18 user nova-compute[72409]: DEBUG nova.compute.manager [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing instance network info cache due to event network-changed-117c1972-75f2-4cd5-a229-53cd2361c506. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:54:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] Acquiring lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a.part --force-share --output=json" returned: 0 in 0.306s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:18 user nova-compute[72409]: DEBUG nova.virt.images [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] f1f9258e-c87d-429e-8cfd-efaaf843840a was qcow2, converting to raw {{(pid=72409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 22:54:18 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 22:54:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a.part /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a.converted {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a.part /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a.converted" returned: 0 in 0.392s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a.converted --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "c9b41a037b00a0760715210d453edbe11519921a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.272s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "c9b41a037b00a0760715210d453edbe11519921a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "c9b41a037b00a0760715210d453edbe11519921a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a,backing_fmt=raw /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621659.6948314, 3f216945-199d-4047-8bc8-407d5842c536 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:54:19 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] VM Resumed (Lifecycle Event)
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a,backing_fmt=raw /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk 1073741824" returned: 0 in 0.077s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "c9b41a037b00a0760715210d453edbe11519921a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:19 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Instance spawned successfully.
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:54:19 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621659.69605, 3f216945-199d-4047-8bc8-407d5842c536 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:54:19 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] VM Started (Lifecycle Event)
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a --force-share --output=json" returned: 0 in 0.192s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:19 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'migration_context' on Instance uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:19 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:54:19 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Rebasing disk image.
Aug 09 22:54:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:20 user nova-compute[72409]: INFO nova.compute.manager [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Took 7.81 seconds to spawn the instance on the hypervisor.
Aug 09 22:54:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:20 user nova-compute[72409]: INFO nova.compute.manager [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Took 9.00 seconds to build instance.
Aug 09 22:54:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.187s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e -F raw /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-339ce2ac-8257-49f2-b20a-6d8c86a7e6d6 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "3f216945-199d-4047-8bc8-407d5842c536" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.150s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:21 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [{"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "49e29e6b-a887-425f-9eca-94a25bdb3301", "address": "fa:16:3e:e7:a2:b1", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e29e6b-a8", "ovs_interfaceid": "49e29e6b-a887-425f-9eca-94a25bdb3301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "117c1972-75f2-4cd5-a229-53cd2361c506", "address": "fa:16:3e:84:1e:d3", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap117c1972-75", "ovs_interfaceid": "117c1972-75f2-4cd5-a229-53cd2361c506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Releasing lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Instance network_info: |[{"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "49e29e6b-a887-425f-9eca-94a25bdb3301", "address": "fa:16:3e:e7:a2:b1", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e29e6b-a8", "ovs_interfaceid": "49e29e6b-a887-425f-9eca-94a25bdb3301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "117c1972-75f2-4cd5-a229-53cd2361c506", "address": "fa:16:3e:84:1e:d3", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap117c1972-75", "ovs_interfaceid": "117c1972-75f2-4cd5-a229-53cd2361c506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:54:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] Acquired lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:21 user nova-compute[72409]: DEBUG nova.network.neutron [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing network info cache for port 117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG nova.network.neutron [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updated VIF entry in instance network info cache for port 117c1972-75f2-4cd5-a229-53cd2361c506. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG nova.network.neutron [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [{"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "49e29e6b-a887-425f-9eca-94a25bdb3301", "address": "fa:16:3e:e7:a2:b1", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e29e6b-a8", "ovs_interfaceid": "49e29e6b-a887-425f-9eca-94a25bdb3301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "117c1972-75f2-4cd5-a229-53cd2361c506", "address": "fa:16:3e:84:1e:d3", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap117c1972-75", "ovs_interfaceid": "117c1972-75f2-4cd5-a229-53cd2361c506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] Releasing lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-changed-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Refreshing instance network info cache due to event network-changed-073bad5c-1f38-4fb0-b4e9-803dd62fcd34. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] Acquiring lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] Acquired lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG nova.network.neutron [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Refreshing network info cache for port 073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:54:22 user nova-compute[72409]: INFO nova.virt.block_device [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Booting with volume a47e67ae-231c-48d6-9528-d2f84c681455 at /dev/vdc
Aug 09 22:54:22 user nova-compute[72409]: DEBUG os_brick.utils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dbb1de-c47e-46a6-b894-a50d04e8f05a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a472bade-55c6-41ea-b57c-b2a66036f958]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd55df3-2243-492f-9f9c-6e55b85591c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e27539-62a5-45a1-9240-cb162171bf9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:54:22 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dbe5a4-7cb1-430b-b63a-902d64472c9d]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG os_brick.utils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] <== get_connector_properties: return (257ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating existing volume attachment record: 8627cc75-3f5e-40df-8558-35f0c7f0deaa {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG nova.network.neutron [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updated VIF entry in instance network info cache for port 073bad5c-1f38-4fb0-b4e9-803dd62fcd34. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG nova.network.neutron [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updating instance_info_cache with network_info: [{"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] Releasing lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] No waiting events found dispatching network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:22 user nova-compute[72409]: WARNING nova.compute.manager [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received unexpected event network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a for instance with vm_state building and task_state spawning.
Aug 09 22:54:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] No waiting events found dispatching network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:22 user nova-compute[72409]: WARNING nova.compute.manager [req-d59cb360-2cf7-483a-beed-a6be342d6bfe req-e68c2d02-2bc3-46d0-82d4-3a0404a8b54b service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received unexpected event network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a for instance with vm_state building and task_state spawning.
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e -F raw /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk" returned: 0 in 3.305s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Ensure instance console log exists: /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Start _get_guest_xml network_info=[{"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='5cf3f392b991be5d9790bb9ae4b2fd5e',container_format='bare',created_at=2023-08-09T22:52:01Z,direct_url=<?>,disk_format='qcow2',id=f1f9258e-c87d-429e-8cfd-efaaf843840a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1676089071-shelved',owner='894e6764aa794ff29ce4bc213a7def7d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T22:52:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTXpGlMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'afc3b053-5a66-420c-8b7a-e33094cb2125', 'serial': 'afc3b053-5a66-420c-8b7a-e33094cb2125'}, 'mount_device': '/dev/vdc', 'attachment_id': '0946406a-946b-4dfd-8f0d-78c2aa85ad27', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:54:23 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:54:23 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5cf3f392b991be5d9790bb9ae4b2fd5e',container_format='bare',created_at=2023-08-09T22:52:01Z,direct_url=<?>,disk_format='qcow2',id=f1f9258e-c87d-429e-8cfd-efaaf843840a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1676089071-shelved',owner='894e6764aa794ff29ce4bc213a7def7d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T22:52:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'vcpu_model' on Instance uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTXpGlMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:54:23 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:54:23 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:54:23 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260" returned: 21 in 0.054s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eb0361-491e-413e-9b21-b44e82416442]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:54:23 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[64140575-4433-443f-826a-c2dc45387ad3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125] added
Aug 09 22:54:23 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.061s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[251124bb-0546-4e6e-bf3b-b6e8f2c96f75]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7fead4-0341-4676-b5ea-2a4948d60476]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTXpGlMK {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTXpGlMK" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2e5c9a-5346-4ce6-befa-7e0a51303784]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HTXpGlMK'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baebfdf-96c2-4734-9f27-910867e9db38]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7426f8-4b62-439c-8b90-80fe90bd47e0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:23 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:23 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:54:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --login" returned: 0 in 0.148s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33158b6-af74-41ae-b52a-2da047f2a0c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125, portal: 172.16.0.220,3260]
Aug 09 22:54:24 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125, portal: 172.16.0.220,3260] successful.
Aug 09 22:54:24 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[786cc302-f0bc-46ba-ac7a-e730a250112d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ed1dcf-c53d-413d-a374-f1e1096ded8c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:24 user nova-compute[72409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:24 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:24 user nova-compute[72409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:24 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.476s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df070b3-572c-460e-8505-7a7fe7a3b652]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTXpGlMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:24 user nova-compute[72409]: INFO nova.compute.manager [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Terminating instance
Aug 09 22:54:24 user nova-compute[72409]: DEBUG nova.compute.manager [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.531s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] <== connect_volume: return (1533ms) {'type': 'block', 'scsi_wwn': '23363643266613165', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363643266613165', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T22:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1676089071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1676089071',id=3,image_ref='f1f9258e-c87d-429e-8cfd-efaaf843840a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-996093995',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='894e6764aa794ff29ce4bc213a7def7d',ramdisk_id='',reservation_id='r-e05l9tyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-723310053',owner_user_name='tempest-AttachVolumeShelveTestJSON-723310053-project-member',shelved_at='2023-08-09T22:52:06.476335',shelved_host='user',shelved_image_id='f1f9258e-c87d-429e-8cfd-efaaf843840a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce008676a8de41b8b2ffe79ab31462df',uuid=19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converting VIF {"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'pci_devices' on Instance uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:54:25 user nova-compute[72409]:   <uuid>19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8</uuid>
Aug 09 22:54:25 user nova-compute[72409]:   <name>instance-00000003</name>
Aug 09 22:54:25 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:54:25 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:54:25 user nova-compute[72409]:   <metadata>
Aug 09 22:54:25 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:54:25 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:54:25 user nova-compute[72409]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1676089071</nova:name>
Aug 09 22:54:25 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:54:23</nova:creationTime>
Aug 09 22:54:25 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:54:25 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:54:25 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:54:25 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:54:25 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:54:25 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:54:25 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:54:25 user nova-compute[72409]:       <nova:owner>
Aug 09 22:54:25 user nova-compute[72409]:         <nova:user uuid="ce008676a8de41b8b2ffe79ab31462df">tempest-AttachVolumeShelveTestJSON-723310053-project-member</nova:user>
Aug 09 22:54:25 user nova-compute[72409]:         <nova:project uuid="894e6764aa794ff29ce4bc213a7def7d">tempest-AttachVolumeShelveTestJSON-723310053</nova:project>
Aug 09 22:54:25 user nova-compute[72409]:       </nova:owner>
Aug 09 22:54:25 user nova-compute[72409]:       <nova:root type="image" uuid="f1f9258e-c87d-429e-8cfd-efaaf843840a"/>
Aug 09 22:54:25 user nova-compute[72409]:       <nova:ports>
Aug 09 22:54:25 user nova-compute[72409]:         <nova:port uuid="073bad5c-1f38-4fb0-b4e9-803dd62fcd34">
Aug 09 22:54:25 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 22:54:25 user nova-compute[72409]:         </nova:port>
Aug 09 22:54:25 user nova-compute[72409]:       </nova:ports>
Aug 09 22:54:25 user nova-compute[72409]:     </nova:instance>
Aug 09 22:54:25 user nova-compute[72409]:   </metadata>
Aug 09 22:54:25 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:54:25 user nova-compute[72409]:     <system>
Aug 09 22:54:25 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:54:25 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:54:25 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:54:25 user nova-compute[72409]:       <entry name="serial">19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8</entry>
Aug 09 22:54:25 user nova-compute[72409]:       <entry name="uuid">19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8</entry>
Aug 09 22:54:25 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:54:25 user nova-compute[72409]:     </system>
Aug 09 22:54:25 user nova-compute[72409]:   </sysinfo>
Aug 09 22:54:25 user nova-compute[72409]:   <os>
Aug 09 22:54:25 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:54:25 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:54:25 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:54:25 user nova-compute[72409]:   </os>
Aug 09 22:54:25 user nova-compute[72409]:   <features>
Aug 09 22:54:25 user nova-compute[72409]:     <acpi/>
Aug 09 22:54:25 user nova-compute[72409]:     <apic/>
Aug 09 22:54:25 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:54:25 user nova-compute[72409]:   </features>
Aug 09 22:54:25 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:54:25 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:54:25 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:54:25 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:54:25 user nova-compute[72409]:   </clock>
Aug 09 22:54:25 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:54:25 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:54:25 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:54:25 user nova-compute[72409]:   </cpu>
Aug 09 22:54:25 user nova-compute[72409]:   <devices>
Aug 09 22:54:25 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:54:25 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:54:25 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk"/>
Aug 09 22:54:25 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:54:25 user nova-compute[72409]:     </disk>
Aug 09 22:54:25 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:54:25 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:54:25 user nova-compute[72409]:       <source dev="/dev/sdb"/>
Aug 09 22:54:25 user nova-compute[72409]:       <target dev="vdc" bus="virtio"/>
Aug 09 22:54:25 user nova-compute[72409]:       <serial>afc3b053-5a66-420c-8b7a-e33094cb2125</serial>
Aug 09 22:54:25 user nova-compute[72409]:     </disk>
Aug 09 22:54:25 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:54:25 user nova-compute[72409]:       <mac address="fa:16:3e:77:5f:b3"/>
Aug 09 22:54:25 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:25 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:54:25 user nova-compute[72409]:       <target dev="tap073bad5c-1f"/>
Aug 09 22:54:25 user nova-compute[72409]:     </interface>
Aug 09 22:54:25 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:54:25 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/console.log" append="off"/>
Aug 09 22:54:25 user nova-compute[72409]:     </serial>
Aug 09 22:54:25 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:54:25 user nova-compute[72409]:     <video>
Aug 09 22:54:25 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:25 user nova-compute[72409]:     </video>
Aug 09 22:54:25 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:54:25 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:54:25 user nova-compute[72409]:     </rng>
Aug 09 22:54:25 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:54:25 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:54:25 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:54:25 user nova-compute[72409]:     </memballoon>
Aug 09 22:54:25 user nova-compute[72409]:   </devices>
Aug 09 22:54:25 user nova-compute[72409]: </domain>
Aug 09 22:54:25 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T22:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1676089071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1676089071',id=3,image_ref='f1f9258e-c87d-429e-8cfd-efaaf843840a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-996093995',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='894e6764aa794ff29ce4bc213a7def7d',ramdisk_id='',reservation_id='r-e05l9tyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-723310053',owner_user_name='tempest-AttachVolumeShelveTestJSON-723310053-project-member',shelved_at='2023-08-09T22:52:06.476335',shelved_host='user',shelved_image_id='f1f9258e-c87d-429e-8cfd-efaaf843840a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce008676a8de41b8b2ffe79ab31462df',uuid=19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converting VIF {"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG os_vif [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap073bad5c-1f, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap073bad5c-1f, col_values=(('external_ids', {'iface-id': '073bad5c-1f38-4fb0-b4e9-803dd62fcd34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:5f:b3', 'vm-uuid': '19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:25 user nova-compute[72409]: INFO os_vif [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f')
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] No VIF found with MAC fa:16:3e:77:5f:b3, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-f8616287-9c90-4286-adca-98e6c1dd3e6d req-598011af-32f9-41f2-b57f-d0ed279bbd0f service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received event network-vif-unplugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f8616287-9c90-4286-adca-98e6c1dd3e6d req-598011af-32f9-41f2-b57f-d0ed279bbd0f service nova] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f8616287-9c90-4286-adca-98e6c1dd3e6d req-598011af-32f9-41f2-b57f-d0ed279bbd0f service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f8616287-9c90-4286-adca-98e6c1dd3e6d req-598011af-32f9-41f2-b57f-d0ed279bbd0f service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-f8616287-9c90-4286-adca-98e6c1dd3e6d req-598011af-32f9-41f2-b57f-d0ed279bbd0f service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] No waiting events found dispatching network-vif-unplugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-f8616287-9c90-4286-adca-98e6c1dd3e6d req-598011af-32f9-41f2-b57f-d0ed279bbd0f service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received event network-vif-unplugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Instance destroyed successfully.
Aug 09 22:54:26 user nova-compute[72409]: DEBUG nova.objects.instance [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lazy-loading 'resources' on Instance uuid 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-290822892',display_name='tempest-TestVolumeSwap-server-290822892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-290822892',id=9,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2K9bVIsnCKXRUyaC0PI5l7dBEUYRM+PUmw3ExgQG9Rh4wfPio/CXDC6bTckE3pUr9SPBU6zQBR0+1tAxRFSNLdYWYMKSbS8RVpyfJ0FyY53Pb6vX0GphL8jXa0LrJlgw==',key_name='tempest-keypair-1606677701',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9bd4aed4e4c43cb9e3096f4f3757776',ramdisk_id='',reservation_id='r-3khbx4w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-650053428',owner_user_name='tempest-TestVolumeSwap-650053428-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df4e2dfc7c744b4d8ee4f285cbd6861e',uuid=2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "address": "fa:16:3e:d7:57:ed", "network": {"id": "9bc6437a-445d-4bd1-8fd5-56e4d64fc45e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1499918820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bd4aed4e4c43cb9e3096f4f3757776", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a0bdd7-ce", "ovs_interfaceid": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Converting VIF {"id": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "address": "fa:16:3e:d7:57:ed", "network": {"id": "9bc6437a-445d-4bd1-8fd5-56e4d64fc45e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1499918820-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bd4aed4e4c43cb9e3096f4f3757776", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47a0bdd7-ce", "ovs_interfaceid": "47a0bdd7-ce8f-475f-a9a0-231959ed4ead", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=47a0bdd7-ce8f-475f-a9a0-231959ed4ead,network=Network(9bc6437a-445d-4bd1-8fd5-56e4d64fc45e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a0bdd7-ce') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG os_vif [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=47a0bdd7-ce8f-475f-a9a0-231959ed4ead,network=Network(9bc6437a-445d-4bd1-8fd5-56e4d64fc45e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a0bdd7-ce') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47a0bdd7-ce, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:26 user nova-compute[72409]: INFO os_vif [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:57:ed,bridge_name='br-int',has_traffic_filtering=True,id=47a0bdd7-ce8f-475f-a9a0-231959ed4ead,network=Network(9bc6437a-445d-4bd1-8fd5-56e4d64fc45e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47a0bdd7-ce')
Aug 09 22:54:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Deleting instance files /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b_del
Aug 09 22:54:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Deletion of /opt/stack/data/nova/instances/2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b_del complete
Aug 09 22:54:26 user nova-compute[72409]: INFO nova.compute.manager [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Took 1.55 seconds to destroy the instance on the hypervisor.
Aug 09 22:54:26 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-4a49fc87-bbc3-40ff-990f-92c6276e695e req-cd0ee03c-d9c4-40e6-a621-b1f12cf42b83 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4a49fc87-bbc3-40ff-990f-92c6276e695e req-cd0ee03c-d9c4-40e6-a621-b1f12cf42b83 service nova] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4a49fc87-bbc3-40ff-990f-92c6276e695e req-cd0ee03c-d9c4-40e6-a621-b1f12cf42b83 service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4a49fc87-bbc3-40ff-990f-92c6276e695e req-cd0ee03c-d9c4-40e6-a621-b1f12cf42b83 service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-4a49fc87-bbc3-40ff-990f-92c6276e695e req-cd0ee03c-d9c4-40e6-a621-b1f12cf42b83 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] No waiting events found dispatching network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:27 user nova-compute[72409]: WARNING nova.compute.manager [req-4a49fc87-bbc3-40ff-990f-92c6276e695e req-cd0ee03c-d9c4-40e6-a621-b1f12cf42b83 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received unexpected event network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 22:54:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received event network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] No waiting events found dispatching network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:28 user nova-compute[72409]: WARNING nova.compute.manager [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received unexpected event network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead for instance with vm_state active and task_state deleting.
Aug 09 22:54:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received event network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] No waiting events found dispatching network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:28 user nova-compute[72409]: WARNING nova.compute.manager [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received unexpected event network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead for instance with vm_state active and task_state deleting.
Aug 09 22:54:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received event network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] No waiting events found dispatching network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:28 user nova-compute[72409]: WARNING nova.compute.manager [req-16f63c0b-cf40-49c6-8943-687d9707081b req-26810dab-10cb-4b11-af8f-5170127a05fd service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received unexpected event network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead for instance with vm_state active and task_state deleting.
Aug 09 22:54:28 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:28 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Took 1.73 seconds to deallocate network for instance.
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.534s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:28 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Deleted allocations for instance 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b
Aug 09 22:54:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-511965ba-f574-4039-8ed5-4dec265d138a tempest-TestVolumeSwap-650053428 tempest-TestVolumeSwap-650053428-project-member] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.183s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621670.0252044, 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:54:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] VM Resumed (Lifecycle Event)
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:54:30 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Instance spawned successfully.
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-42730e68-540a-483b-a3ea-b93321b68194 req-6bf49095-9409-41ac-834f-92fb5e7b11ec service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received event network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-42730e68-540a-483b-a3ea-b93321b68194 req-6bf49095-9409-41ac-834f-92fb5e7b11ec service nova] Acquiring lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-42730e68-540a-483b-a3ea-b93321b68194 req-6bf49095-9409-41ac-834f-92fb5e7b11ec service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-42730e68-540a-483b-a3ea-b93321b68194 req-6bf49095-9409-41ac-834f-92fb5e7b11ec service nova] Lock "2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-42730e68-540a-483b-a3ea-b93321b68194 req-6bf49095-9409-41ac-834f-92fb5e7b11ec service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] No waiting events found dispatching network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:30 user nova-compute[72409]: WARNING nova.compute.manager [req-42730e68-540a-483b-a3ea-b93321b68194 req-6bf49095-9409-41ac-834f-92fb5e7b11ec service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received unexpected event network-vif-plugged-47a0bdd7-ce8f-475f-a9a0-231959ed4ead for instance with vm_state deleted and task_state None.
Aug 09 22:54:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621670.0313544, 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:54:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] VM Started (Lifecycle Event)
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:54:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-8bbcf595-eefb-412a-8602-55b238a4b785 req-5382bf87-369b-4952-9d23-4bae729c99d2 service nova] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Received event network-vif-deleted-47a0bdd7-ce8f-475f-a9a0-231959ed4ead {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-8bbcf595-eefb-412a-8602-55b238a4b785 req-5382bf87-369b-4952-9d23-4bae729c99d2 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8bbcf595-eefb-412a-8602-55b238a4b785 req-5382bf87-369b-4952-9d23-4bae729c99d2 service nova] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8bbcf595-eefb-412a-8602-55b238a4b785 req-5382bf87-369b-4952-9d23-4bae729c99d2 service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8bbcf595-eefb-412a-8602-55b238a4b785 req-5382bf87-369b-4952-9d23-4bae729c99d2 service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-8bbcf595-eefb-412a-8602-55b238a4b785 req-5382bf87-369b-4952-9d23-4bae729c99d2 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] No waiting events found dispatching network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:30 user nova-compute[72409]: WARNING nova.compute.manager [req-8bbcf595-eefb-412a-8602-55b238a4b785 req-5382bf87-369b-4952-9d23-4bae729c99d2 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received unexpected event network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 22:54:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1de15648-039d-442d-9923-48e41bfd71d3 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 35.446s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:54:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Creating image(s)
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Ensure instance console log exists: /opt/stack/data/nova/instances/f7f4be37-e516-4cd5-82bd-fa554f5e4c18/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Start _get_guest_xml network_info=[{"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "49e29e6b-a887-425f-9eca-94a25bdb3301", "address": "fa:16:3e:e7:a2:b1", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e29e6b-a8", "ovs_interfaceid": "49e29e6b-a887-425f-9eca-94a25bdb3301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "117c1972-75f2-4cd5-a229-53cd2361c506", "address": "fa:16:3e:84:1e:d3", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap117c1972-75", "ovs_interfaceid": "117c1972-75f2-4cd5-a229-53cd2361c506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMiDTeyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7f4be37-e516-4cd5-82bd-fa554f5e4c18', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7d8d350-15a0-4271-9b13-f063e5b7e68a', 'serial': 'c7d8d350-15a0-4271-9b13-f063e5b7e68a'}, 'mount_device': '/dev/vda', 'attachment_id': '51970fdf-0cb0-4c27-a75a-09c23abd9527', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoeJOZVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7f4be37-e516-4cd5-82bd-fa554f5e4c18', 'attached_at': '', 'detached_at': '', 'volume_id': '99d4523c-9193-4225-a542-03bab1455a56', 'serial': '99d4523c-9193-4225-a542-03bab1455a56'}, 'mount_device': '/dev/vdb', 'attachment_id': 'e7666532-ae32-425a-bfa1-65c1862b6702', 'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZyvrkfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7f4be37-e516-4cd5-82bd-fa554f5e4c18', 'attached_at': '', 'detached_at': '', 'volume_id': 'a47e67ae-231c-48d6-9528-d2f84c681455', 'serial': 'a47e67ae-231c-48d6-9528-d2f84c681455'}, 'mount_device': '/dev/vdc', 'attachment_id': '8627cc75-3f5e-40df-8558-35f0c7f0deaa', 'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:54:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:54:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMiDTeyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:54:34 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:54:34 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:54:34 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7327f6c-832e-4f6f-89a5-924cf27ec999]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:54:34 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[254f7db8-9ace-4b77-8731-9ea0aa5ff249]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a] added
Aug 09 22:54:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed9d233-09c5-4c76-9085-b5548d5cdba1]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6f487d-b68b-4ae9-87d8-bffbd923ab92]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMiDTeyI {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMiDTeyI" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[982741d6-d9c1-403c-a065-fce8a50fa263]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qMiDTeyI'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b926eab-02cb-4d69-864f-736dc89ba20b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0287cf9-a3c7-4a34-86ab-fa56ec61c783]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:34 user nova-compute[72409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:34 user nova-compute[72409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e69e6d2-eac2-4b3b-a0a0-ca5e31e72f96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a, portal: 172.16.0.220,3260]
Aug 09 22:54:34 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a, portal: 172.16.0.220,3260] successful.
Aug 09 22:54:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9fa38c-35d8-4f12-82ea-6fd2f0f19a1c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5476fd-29dc-4466-a692-8aa4e8845cf9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:34 user nova-compute[72409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:34 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:54:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:34 user nova-compute[72409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:34 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:54:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.042s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6122c9-167b-43f6-a5fc-7e9ab57b1d98]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:54:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMiDTeyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23961323636623238', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961323636623238', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoeJOZVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:54:35 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:54:35 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:54:35 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[358bae1a-c9f6-49fc-87a1-be2f26447812]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:54:35 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[052f1273-6691-4fc2-89ec-5105150ccf54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56] added
Aug 09 22:54:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a30bd8-2b3b-4ff5-ae16-4693a8476ee6]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbab7b4c-0acd-4b65-a855-7bb8f5f7434a]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aoeJOZVy {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aoeJOZVy" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a63244-fd21-4422-bdb5-306360149fdb]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aoeJOZVy'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4a7ac5-bb6d-4156-b23e-1dbafa826d9b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[743726a4-d8c5-484d-b8d6-3c85e4591c0b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:35 user nova-compute[72409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:35 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:54:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:35 user nova-compute[72409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:35 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:54:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:35 user nova-compute[72409]: INFO nova.compute.manager [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Terminating instance
Aug 09 22:54:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[940b1765-489a-4ccb-a5aa-4635ad356415]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56, portal: 172.16.0.220,3260]
Aug 09 22:54:35 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56, portal: 172.16.0.220,3260] successful.
Aug 09 22:54:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73b8c0f-265a-45ef-8654-3c1fad5d991a]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a379518-be85-4ab6-9ff3-8167a8f4825a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:35 user nova-compute[72409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:35 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:54:35 user nova-compute[72409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:54:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:35 user nova-compute[72409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:35 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:54:35 user nova-compute[72409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:54:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:54:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bc183c-f4d7-497a-8a92-fce809566e9f]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoeJOZVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-040d800a-d3fc-47f0-a584-0ac901f8c304 req-99ac9756-8fa4-40f2-a726-61c37a4ffd46 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event network-vif-unplugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-040d800a-d3fc-47f0-a584-0ac901f8c304 req-99ac9756-8fa4-40f2-a726-61c37a4ffd46 service nova] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-040d800a-d3fc-47f0-a584-0ac901f8c304 req-99ac9756-8fa4-40f2-a726-61c37a4ffd46 service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-040d800a-d3fc-47f0-a584-0ac901f8c304 req-99ac9756-8fa4-40f2-a726-61c37a4ffd46 service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-040d800a-d3fc-47f0-a584-0ac901f8c304 req-99ac9756-8fa4-40f2-a726-61c37a4ffd46 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] No waiting events found dispatching network-vif-unplugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-040d800a-d3fc-47f0-a584-0ac901f8c304 req-99ac9756-8fa4-40f2-a726-61c37a4ffd46 service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event network-vif-unplugged-c37915d3-63af-47d7-8618-adee0e79e4ce for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:36 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Instance destroyed successfully.
Aug 09 22:54:36 user nova-compute[72409]: DEBUG nova.objects.instance [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lazy-loading 'resources' on Instance uuid 29a04807-1c46-4546-b78c-73d4f2b86c46 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T22:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-632707458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1227232666',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAoSaQCdVvuh57WXjFA13EBow7aKBmqRgJwb6HwSpyFB+eussplICF19CzXtR/xzCNYd09zaCo7OZWi2arzQlCx/TWpdlW31VSARWFAbCK5rWCe0CK613+EMVVBpM3mvg==',key_name='tempest-keypair-1505891920',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:53:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='501f4894d8ce46d08a02baf924d7e51e',ramdisk_id='',reservation_id='r-6hu0v00n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1870090794',owner_user_name='tempest-ServerActionsV293TestJSON-1870090794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0be4e91cf0054f548ea7a1d75426b72b',uuid=29a04807-1c46-4546-b78c-73d4f2b86c46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Converting VIF {"id": "c37915d3-63af-47d7-8618-adee0e79e4ce", "address": "fa:16:3e:e3:4b:f8", "network": {"id": "81313d12-0b3d-415a-bae4-2320cc1ec5b4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1872255048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "501f4894d8ce46d08a02baf924d7e51e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc37915d3-63", "ovs_interfaceid": "c37915d3-63af-47d7-8618-adee0e79e4ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG os_vif [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc37915d3-63, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:36 user nova-compute[72409]: INFO os_vif [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:4b:f8,bridge_name='br-int',has_traffic_filtering=True,id=c37915d3-63af-47d7-8618-adee0e79e4ce,network=Network(81313d12-0b3d-415a-bae4-2320cc1ec5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc37915d3-63')
Aug 09 22:54:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:54:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSJapLlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:54:36 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:54:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23930663334326362', 'path': '/dev/sde'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930663334326362', 'path': '/dev/sde'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.216s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[580f5947-95cf-45d6-af07-6877199599e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[87af34f5-c370-41d0-b334-b169609081c0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZyvrkfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:54:37 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e844348b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145'): ({'sdd'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Removing single pathed devices sdd {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4811fb92-e251-4a85-b0d8-9f13ae831248]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.039s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[753dc544-5c06-49e9-9a3f-fb5b0480b0e6]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Flushing IO for device /dev/sdd {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d1261f-81ec-4c87-9d76-f3f5a4442b81]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3dde6a-0a90-41ea-99c5-7ca4c740130d]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5816ac51-c4e9-429b-855d-3cfa5dc94b89]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[04277652-9c35-479c-bd09-44ad8267efab]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260]
Aug 09 22:54:37 user nova-compute[72409]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145, portal: 172.16.0.220,3260] successful.
Aug 09 22:54:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:531786d5-d1a0-48d4-9074-1d5dd0797145 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17884c5-6139-4f10-ae7e-121ab88edbae]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] <== disconnect_volume: return (630ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:54:37 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Deleting instance files /opt/stack/data/nova/instances/29a04807-1c46-4546-b78c-73d4f2b86c46_del
Aug 09 22:54:37 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Deletion of /opt/stack/data/nova/instances/29a04807-1c46-4546-b78c-73d4f2b86c46_del complete
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.342s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:54:37 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:54:37 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[106a93d6-e403-4d73-baa9-031c2dca2fd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:54:37 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f88a54-db3d-4b6a-bcf7-cf89ad605da2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455] added
Aug 09 22:54:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:37 user nova-compute[72409]: INFO nova.compute.manager [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Took 1.62 seconds to destroy the instance on the hypervisor.
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b27e673-502d-467f-974c-117219467098]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51a772a-ec36-4b22-bc61-3ed430be3652]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sZyvrkfN {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sZyvrkfN" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae190a2-6325-4754-9dfb-07db34adcf53]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sZyvrkfN'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbbf64e-5679-457d-97ac-bb1d496cbe53]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3a2a92-4054-4894-9462-462e239ccbbb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ef7b5d-1a87-438b-849c-9cc3fedc84d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455, portal: 172.16.0.220,3260]
Aug 09 22:54:37 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455, portal: 172.16.0.220,3260] successful.
Aug 09 22:54:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6474eb8c-e9d0-4c01-83e7-6e8a507932ce]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[346ffb3c-60e2-4a5c-a53d-393ef01454ba]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)
Aug 09 22:54:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3e347f-1ee6-4e9d-b400-a6de991546e4]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:54:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZyvrkfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-73eeeedb-9c09-4a7d-9959-9127217f042d req-00d52ab3-8828-4cb4-b5b0-7853927a771e service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-73eeeedb-9c09-4a7d-9959-9127217f042d req-00d52ab3-8828-4cb4-b5b0-7853927a771e service nova] Acquiring lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-73eeeedb-9c09-4a7d-9959-9127217f042d req-00d52ab3-8828-4cb4-b5b0-7853927a771e service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-73eeeedb-9c09-4a7d-9959-9127217f042d req-00d52ab3-8828-4cb4-b5b0-7853927a771e service nova] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-73eeeedb-9c09-4a7d-9959-9127217f042d req-00d52ab3-8828-4cb4-b5b0-7853927a771e service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] No waiting events found dispatching network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:38 user nova-compute[72409]: WARNING nova.compute.manager [req-73eeeedb-9c09-4a7d-9959-9127217f042d req-00d52ab3-8828-4cb4-b5b0-7853927a771e service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received unexpected event network-vif-plugged-c37915d3-63af-47d7-8618-adee0e79e4ce for instance with vm_state active and task_state deleting.
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-73eeeedb-9c09-4a7d-9959-9127217f042d req-00d52ab3-8828-4cb4-b5b0-7853927a771e service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Received event network-vif-deleted-c37915d3-63af-47d7-8618-adee0e79e4ce {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:38 user nova-compute[72409]: INFO nova.compute.manager [req-73eeeedb-9c09-4a7d-9959-9127217f042d req-00d52ab3-8828-4cb4-b5b0-7853927a771e service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Neutron deleted interface c37915d3-63af-47d7-8618-adee0e79e4ce; detaching it from the instance and deleting it from the info cache
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.neutron [req-73eeeedb-9c09-4a7d-9959-9127217f042d req-00d52ab3-8828-4cb4-b5b0-7853927a771e service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:38 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Took 1.19 seconds to deallocate network for instance.
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-73eeeedb-9c09-4a7d-9959-9127217f042d req-00d52ab3-8828-4cb4-b5b0-7853927a771e service nova] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Detach interface failed, port_id=c37915d3-63af-47d7-8618-adee0e79e4ce, reason: Instance 29a04807-1c46-4546-b78c-73d4f2b86c46 could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] <== connect_volume: return (1728ms) {'type': 'block', 'scsi_wwn': '26364313863313164', 'path': '/dev/sdd'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364313863313164', 'path': '/dev/sdd'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:77:7d,bridge_name='br-int',has_traffic_filtering=True,id=c14ceb07-7e71-4723-88ff-482f29035aa0,network=Network(ed8d100d-7560-497e-a67c-dfa6c94bc7d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ceb07-7e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:bd,bridge_name='br-int',has_traffic_filtering=True,id=5da1a50d-d954-4558-ab6a-334eb3986c37,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5da1a50d-d9') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:7d,bridge_name='br-int',has_traffic_filtering=True,id=c7073d80-257f-4127-823e-13f02e3997e3,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc7073d80-25') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:6c:43,bridge_name='br-int',has_traffic_filtering=True,id=d0512c07-7c8a-4e50-8a26-218871739981,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0512c07-7c') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:00:46,bridge_name='br-int',has_traffic_filtering=True,id=596e3df6-8719-490f-8f60-73578c9cf511,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596e3df6-87') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49e29e6b-a887-425f-9eca-94a25bdb3301", "address": "fa:16:3e:e7:a2:b1", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e29e6b-a8", "ovs_interfaceid": "49e29e6b-a887-425f-9eca-94a25bdb3301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "49e29e6b-a887-425f-9eca-94a25bdb3301", "address": "fa:16:3e:e7:a2:b1", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e29e6b-a8", "ovs_interfaceid": "49e29e6b-a887-425f-9eca-94a25bdb3301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a2:b1,bridge_name='br-int',has_traffic_filtering=True,id=49e29e6b-a887-425f-9eca-94a25bdb3301,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e29e6b-a8') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "117c1972-75f2-4cd5-a229-53cd2361c506", "address": "fa:16:3e:84:1e:d3", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap117c1972-75", "ovs_interfaceid": "117c1972-75f2-4cd5-a229-53cd2361c506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "117c1972-75f2-4cd5-a229-53cd2361c506", "address": "fa:16:3e:84:1e:d3", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap117c1972-75", "ovs_interfaceid": "117c1972-75f2-4cd5-a229-53cd2361c506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:1e:d3,bridge_name='br-int',has_traffic_filtering=True,id=117c1972-75f2-4cd5-a229-53cd2361c506,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117c1972-75') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lazy-loading 'pci_devices' on Instance uuid f7f4be37-e516-4cd5-82bd-fa554f5e4c18 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:54:38 user nova-compute[72409]:   <uuid>f7f4be37-e516-4cd5-82bd-fa554f5e4c18</uuid>
Aug 09 22:54:38 user nova-compute[72409]:   <name>instance-0000000f</name>
Aug 09 22:54:38 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:54:38 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:54:38 user nova-compute[72409]:   <metadata>
Aug 09 22:54:38 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:54:38 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:54:38 user nova-compute[72409]:       <nova:name>tempest-device-tagging-server-848445428</nova:name>
Aug 09 22:54:38 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:54:34</nova:creationTime>
Aug 09 22:54:38 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:54:38 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:54:38 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:54:38 user nova-compute[72409]:       <nova:owner>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:user uuid="d18abb14d08141a487b3bd0f51333be8">tempest-TaggedBootDevicesTest_v242-331933323-project-member</nova:user>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:project uuid="ebc4cb0f78e64f8ea5b40bb6d20cc107">tempest-TaggedBootDevicesTest_v242-331933323</nova:project>
Aug 09 22:54:38 user nova-compute[72409]:       </nova:owner>
Aug 09 22:54:38 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:54:38 user nova-compute[72409]:       <nova:ports>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:port uuid="c14ceb07-7e71-4723-88ff-482f29035aa0">
Aug 09 22:54:38 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 22:54:38 user nova-compute[72409]:         </nova:port>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:port uuid="5da1a50d-d954-4558-ab6a-334eb3986c37">
Aug 09 22:54:38 user nova-compute[72409]:           <nova:ip type="fixed" address="10.1.1.122" ipVersion="4"/>
Aug 09 22:54:38 user nova-compute[72409]:         </nova:port>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:port uuid="c7073d80-257f-4127-823e-13f02e3997e3">
Aug 09 22:54:38 user nova-compute[72409]:           <nova:ip type="fixed" address="10.1.1.212" ipVersion="4"/>
Aug 09 22:54:38 user nova-compute[72409]:         </nova:port>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:port uuid="d0512c07-7c8a-4e50-8a26-218871739981">
Aug 09 22:54:38 user nova-compute[72409]:           <nova:ip type="fixed" address="10.1.1.52" ipVersion="4"/>
Aug 09 22:54:38 user nova-compute[72409]:         </nova:port>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:port uuid="596e3df6-8719-490f-8f60-73578c9cf511">
Aug 09 22:54:38 user nova-compute[72409]:           <nova:ip type="fixed" address="10.1.1.12" ipVersion="4"/>
Aug 09 22:54:38 user nova-compute[72409]:         </nova:port>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:port uuid="49e29e6b-a887-425f-9eca-94a25bdb3301">
Aug 09 22:54:38 user nova-compute[72409]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 22:54:38 user nova-compute[72409]:         </nova:port>
Aug 09 22:54:38 user nova-compute[72409]:         <nova:port uuid="117c1972-75f2-4cd5-a229-53cd2361c506">
Aug 09 22:54:38 user nova-compute[72409]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 22:54:38 user nova-compute[72409]:         </nova:port>
Aug 09 22:54:38 user nova-compute[72409]:       </nova:ports>
Aug 09 22:54:38 user nova-compute[72409]:     </nova:instance>
Aug 09 22:54:38 user nova-compute[72409]:   </metadata>
Aug 09 22:54:38 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:54:38 user nova-compute[72409]:     <system>
Aug 09 22:54:38 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:54:38 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:54:38 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:54:38 user nova-compute[72409]:       <entry name="serial">f7f4be37-e516-4cd5-82bd-fa554f5e4c18</entry>
Aug 09 22:54:38 user nova-compute[72409]:       <entry name="uuid">f7f4be37-e516-4cd5-82bd-fa554f5e4c18</entry>
Aug 09 22:54:38 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:54:38 user nova-compute[72409]:     </system>
Aug 09 22:54:38 user nova-compute[72409]:   </sysinfo>
Aug 09 22:54:38 user nova-compute[72409]:   <os>
Aug 09 22:54:38 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:54:38 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:54:38 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:54:38 user nova-compute[72409]:   </os>
Aug 09 22:54:38 user nova-compute[72409]:   <features>
Aug 09 22:54:38 user nova-compute[72409]:     <acpi/>
Aug 09 22:54:38 user nova-compute[72409]:     <apic/>
Aug 09 22:54:38 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:54:38 user nova-compute[72409]:   </features>
Aug 09 22:54:38 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:54:38 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:54:38 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:54:38 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:54:38 user nova-compute[72409]:   </clock>
Aug 09 22:54:38 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:54:38 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:54:38 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:54:38 user nova-compute[72409]:   </cpu>
Aug 09 22:54:38 user nova-compute[72409]:   <devices>
Aug 09 22:54:38 user nova-compute[72409]:     <disk type="file" device="cdrom">
Aug 09 22:54:38 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 22:54:38 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/f7f4be37-e516-4cd5-82bd-fa554f5e4c18/disk.config"/>
Aug 09 22:54:38 user nova-compute[72409]:       <target dev="hda" bus="ide"/>
Aug 09 22:54:38 user nova-compute[72409]:     </disk>
Aug 09 22:54:38 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:54:38 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:54:38 user nova-compute[72409]:       <source dev="/dev/sdc"/>
Aug 09 22:54:38 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:54:38 user nova-compute[72409]:       <serial>c7d8d350-15a0-4271-9b13-f063e5b7e68a</serial>
Aug 09 22:54:38 user nova-compute[72409]:     </disk>
Aug 09 22:54:38 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:54:38 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:54:38 user nova-compute[72409]:       <source dev="/dev/sde"/>
Aug 09 22:54:38 user nova-compute[72409]:       <target dev="vdb" bus="virtio"/>
Aug 09 22:54:38 user nova-compute[72409]:       <serial>99d4523c-9193-4225-a542-03bab1455a56</serial>
Aug 09 22:54:38 user nova-compute[72409]:     </disk>
Aug 09 22:54:38 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:54:38 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:54:38 user nova-compute[72409]:       <source dev="/dev/sdd"/>
Aug 09 22:54:38 user nova-compute[72409]:       <target dev="vdc" bus="virtio"/>
Aug 09 22:54:38 user nova-compute[72409]:       <serial>a47e67ae-231c-48d6-9528-d2f84c681455</serial>
Aug 09 22:54:38 user nova-compute[72409]:     </disk>
Aug 09 22:54:38 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:54:38 user nova-compute[72409]:       <mac address="fa:16:3e:14:77:7d"/>
Aug 09 22:54:38 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:38 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:54:38 user nova-compute[72409]:       <target dev="tapc14ceb07-7e"/>
Aug 09 22:54:38 user nova-compute[72409]:     </interface>
Aug 09 22:54:38 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:54:38 user nova-compute[72409]:       <mac address="fa:16:3e:bc:d0:bd"/>
Aug 09 22:54:38 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:38 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:54:38 user nova-compute[72409]:       <target dev="tap5da1a50d-d9"/>
Aug 09 22:54:38 user nova-compute[72409]:     </interface>
Aug 09 22:54:38 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:54:38 user nova-compute[72409]:       <mac address="fa:16:3e:44:ca:7d"/>
Aug 09 22:54:38 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:38 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:54:38 user nova-compute[72409]:       <target dev="tapc7073d80-25"/>
Aug 09 22:54:38 user nova-compute[72409]:     </interface>
Aug 09 22:54:38 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:54:38 user nova-compute[72409]:       <mac address="fa:16:3e:c2:6c:43"/>
Aug 09 22:54:38 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:38 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:54:38 user nova-compute[72409]:       <target dev="tapd0512c07-7c"/>
Aug 09 22:54:38 user nova-compute[72409]:     </interface>
Aug 09 22:54:38 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:54:38 user nova-compute[72409]:       <mac address="fa:16:3e:3c:00:46"/>
Aug 09 22:54:38 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:38 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:54:38 user nova-compute[72409]:       <target dev="tap596e3df6-87"/>
Aug 09 22:54:38 user nova-compute[72409]:     </interface>
Aug 09 22:54:38 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:54:38 user nova-compute[72409]:       <mac address="fa:16:3e:e7:a2:b1"/>
Aug 09 22:54:38 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:38 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:54:38 user nova-compute[72409]:       <target dev="tap49e29e6b-a8"/>
Aug 09 22:54:38 user nova-compute[72409]:     </interface>
Aug 09 22:54:38 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:54:38 user nova-compute[72409]:       <mac address="fa:16:3e:84:1e:d3"/>
Aug 09 22:54:38 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:38 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:54:38 user nova-compute[72409]:       <target dev="tap117c1972-75"/>
Aug 09 22:54:38 user nova-compute[72409]:     </interface>
Aug 09 22:54:38 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:54:38 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/f7f4be37-e516-4cd5-82bd-fa554f5e4c18/console.log" append="off"/>
Aug 09 22:54:38 user nova-compute[72409]:     </serial>
Aug 09 22:54:38 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:54:38 user nova-compute[72409]:     <video>
Aug 09 22:54:38 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:38 user nova-compute[72409]:     </video>
Aug 09 22:54:38 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:54:38 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:54:38 user nova-compute[72409]:     </rng>
Aug 09 22:54:38 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:54:38 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:54:38 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:54:38 user nova-compute[72409]:     </memballoon>
Aug 09 22:54:38 user nova-compute[72409]:   </devices>
Aug 09 22:54:38 user nova-compute[72409]: </domain>
Aug 09 22:54:38 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:77:7d,bridge_name='br-int',has_traffic_filtering=True,id=c14ceb07-7e71-4723-88ff-482f29035aa0,network=Network(ed8d100d-7560-497e-a67c-dfa6c94bc7d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ceb07-7e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:77:7d,bridge_name='br-int',has_traffic_filtering=True,id=c14ceb07-7e71-4723-88ff-482f29035aa0,network=Network(ed8d100d-7560-497e-a67c-dfa6c94bc7d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ceb07-7e') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc14ceb07-7e, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc14ceb07-7e, col_values=(('external_ids', {'iface-id': 'c14ceb07-7e71-4723-88ff-482f29035aa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:77:7d', 'vm-uuid': 'f7f4be37-e516-4cd5-82bd-fa554f5e4c18'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:38 user nova-compute[72409]: INFO os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:77:7d,bridge_name='br-int',has_traffic_filtering=True,id=c14ceb07-7e71-4723-88ff-482f29035aa0,network=Network(ed8d100d-7560-497e-a67c-dfa6c94bc7d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ceb07-7e')
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:bd,bridge_name='br-int',has_traffic_filtering=True,id=5da1a50d-d954-4558-ab6a-334eb3986c37,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5da1a50d-d9') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:bd,bridge_name='br-int',has_traffic_filtering=True,id=5da1a50d-d954-4558-ab6a-334eb3986c37,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5da1a50d-d9') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5da1a50d-d9, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5da1a50d-d9, col_values=(('external_ids', {'iface-id': '5da1a50d-d954-4558-ab6a-334eb3986c37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:d0:bd', 'vm-uuid': 'f7f4be37-e516-4cd5-82bd-fa554f5e4c18'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:38 user nova-compute[72409]: INFO os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:bd,bridge_name='br-int',has_traffic_filtering=True,id=5da1a50d-d954-4558-ab6a-334eb3986c37,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5da1a50d-d9')
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:7d,bridge_name='br-int',has_traffic_filtering=True,id=c7073d80-257f-4127-823e-13f02e3997e3,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc7073d80-25') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:7d,bridge_name='br-int',has_traffic_filtering=True,id=c7073d80-257f-4127-823e-13f02e3997e3,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc7073d80-25') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7073d80-25, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7073d80-25, col_values=(('external_ids', {'iface-id': 'c7073d80-257f-4127-823e-13f02e3997e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:ca:7d', 'vm-uuid': 'f7f4be37-e516-4cd5-82bd-fa554f5e4c18'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: INFO os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:7d,bridge_name='br-int',has_traffic_filtering=True,id=c7073d80-257f-4127-823e-13f02e3997e3,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc7073d80-25')
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:6c:43,bridge_name='br-int',has_traffic_filtering=True,id=d0512c07-7c8a-4e50-8a26-218871739981,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0512c07-7c') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:6c:43,bridge_name='br-int',has_traffic_filtering=True,id=d0512c07-7c8a-4e50-8a26-218871739981,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0512c07-7c') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0512c07-7c, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0512c07-7c, col_values=(('external_ids', {'iface-id': 'd0512c07-7c8a-4e50-8a26-218871739981', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:6c:43', 'vm-uuid': 'f7f4be37-e516-4cd5-82bd-fa554f5e4c18'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: INFO os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:6c:43,bridge_name='br-int',has_traffic_filtering=True,id=d0512c07-7c8a-4e50-8a26-218871739981,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0512c07-7c')
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:00:46,bridge_name='br-int',has_traffic_filtering=True,id=596e3df6-8719-490f-8f60-73578c9cf511,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596e3df6-87') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:00:46,bridge_name='br-int',has_traffic_filtering=True,id=596e3df6-8719-490f-8f60-73578c9cf511,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596e3df6-87') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap596e3df6-87, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap596e3df6-87, col_values=(('external_ids', {'iface-id': '596e3df6-8719-490f-8f60-73578c9cf511', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:00:46', 'vm-uuid': 'f7f4be37-e516-4cd5-82bd-fa554f5e4c18'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: INFO os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:00:46,bridge_name='br-int',has_traffic_filtering=True,id=596e3df6-8719-490f-8f60-73578c9cf511,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596e3df6-87')
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49e29e6b-a887-425f-9eca-94a25bdb3301", "address": "fa:16:3e:e7:a2:b1", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e29e6b-a8", "ovs_interfaceid": "49e29e6b-a887-425f-9eca-94a25bdb3301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "49e29e6b-a887-425f-9eca-94a25bdb3301", "address": "fa:16:3e:e7:a2:b1", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e29e6b-a8", "ovs_interfaceid": "49e29e6b-a887-425f-9eca-94a25bdb3301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a2:b1,bridge_name='br-int',has_traffic_filtering=True,id=49e29e6b-a887-425f-9eca-94a25bdb3301,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e29e6b-a8') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a2:b1,bridge_name='br-int',has_traffic_filtering=True,id=49e29e6b-a887-425f-9eca-94a25bdb3301,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e29e6b-a8') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49e29e6b-a8, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49e29e6b-a8, col_values=(('external_ids', {'iface-id': '49e29e6b-a887-425f-9eca-94a25bdb3301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:a2:b1', 'vm-uuid': 'f7f4be37-e516-4cd5-82bd-fa554f5e4c18'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: INFO os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a2:b1,bridge_name='br-int',has_traffic_filtering=True,id=49e29e6b-a887-425f-9eca-94a25bdb3301,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e29e6b-a8')
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "117c1972-75f2-4cd5-a229-53cd2361c506", "address": "fa:16:3e:84:1e:d3", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap117c1972-75", "ovs_interfaceid": "117c1972-75f2-4cd5-a229-53cd2361c506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "117c1972-75f2-4cd5-a229-53cd2361c506", "address": "fa:16:3e:84:1e:d3", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap117c1972-75", "ovs_interfaceid": "117c1972-75f2-4cd5-a229-53cd2361c506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:1e:d3,bridge_name='br-int',has_traffic_filtering=True,id=117c1972-75f2-4cd5-a229-53cd2361c506,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117c1972-75') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:1e:d3,bridge_name='br-int',has_traffic_filtering=True,id=117c1972-75f2-4cd5-a229-53cd2361c506,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117c1972-75') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap117c1972-75, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap117c1972-75, col_values=(('external_ids', {'iface-id': '117c1972-75f2-4cd5-a229-53cd2361c506', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:1e:d3', 'vm-uuid': 'f7f4be37-e516-4cd5-82bd-fa554f5e4c18'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: INFO os_vif [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:1e:d3,bridge_name='br-int',has_traffic_filtering=True,id=117c1972-75f2-4cd5-a229-53cd2361c506,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117c1972-75')
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] No BDM found with device name hda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] No VIF found with MAC fa:16:3e:14:77:7d, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] No VIF found with MAC fa:16:3e:3c:00:46, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:54:39 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Using config drive
Aug 09 22:54:39 user nova-compute[72409]: INFO nova.compute.manager [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Took 1.01 seconds to detach 1 volumes for instance.
Aug 09 22:54:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Deleting volume: 531786d5-d1a0-48d4-9074-1d5dd0797145 {{(pid=72409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 22:54:39 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Creating config drive at /opt/stack/data/nova/instances/f7f4be37-e516-4cd5-82bd-fa554f5e4c18/disk.config
Aug 09 22:54:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f7f4be37-e516-4cd5-82bd-fa554f5e4c18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo46ahk84 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f7f4be37-e516-4cd5-82bd-fa554f5e4c18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo46ahk84" returned: 0 in 0.076s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:40 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:54:40 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:54:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:40 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Deleted allocations for instance 29a04807-1c46-4546-b78c-73d4f2b86c46
Aug 09 22:54:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6a5dd1ae-017b-49fe-98b7-9ef3027bf957 tempest-ServerActionsV293TestJSON-1870090794 tempest-ServerActionsV293TestJSON-1870090794-project-member] Lock "29a04807-1c46-4546-b78c-73d4f2b86c46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.687s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:41 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621666.172368, 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:54:41 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] VM Stopped (Lifecycle Event)
Aug 09 22:54:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8a82d7e2-5fd6-450c-baac-aad28009a39d None None] [instance: 2bc61d07-a9e1-4b39-87c3-7b7dfc8a340b] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-cc04415c-99d7-447e-8b41-92f43e5bfe3f req-43e89464-cb17-4575-802c-54efe07a274c service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cc04415c-99d7-447e-8b41-92f43e5bfe3f req-43e89464-cb17-4575-802c-54efe07a274c service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cc04415c-99d7-447e-8b41-92f43e5bfe3f req-43e89464-cb17-4575-802c-54efe07a274c service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cc04415c-99d7-447e-8b41-92f43e5bfe3f req-43e89464-cb17-4575-802c-54efe07a274c service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-cc04415c-99d7-447e-8b41-92f43e5bfe3f req-43e89464-cb17-4575-802c-54efe07a274c service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:42 user nova-compute[72409]: WARNING nova.compute.manager [req-cc04415c-99d7-447e-8b41-92f43e5bfe3f req-43e89464-cb17-4575-802c-54efe07a274c service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-c14ceb07-7e71-4723-88ff-482f29035aa0 for instance with vm_state building and task_state spawning.
Aug 09 22:54:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-7afedf8d-71a2-444e-9217-490fb53b9904 req-63950e0d-3def-4c06-9944-40459120abb3 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-5da1a50d-d954-4558-ab6a-334eb3986c37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7afedf8d-71a2-444e-9217-490fb53b9904 req-63950e0d-3def-4c06-9944-40459120abb3 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7afedf8d-71a2-444e-9217-490fb53b9904 req-63950e0d-3def-4c06-9944-40459120abb3 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7afedf8d-71a2-444e-9217-490fb53b9904 req-63950e0d-3def-4c06-9944-40459120abb3 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-7afedf8d-71a2-444e-9217-490fb53b9904 req-63950e0d-3def-4c06-9944-40459120abb3 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-5da1a50d-d954-4558-ab6a-334eb3986c37 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:42 user nova-compute[72409]: WARNING nova.compute.manager [req-7afedf8d-71a2-444e-9217-490fb53b9904 req-63950e0d-3def-4c06-9944-40459120abb3 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-5da1a50d-d954-4558-ab6a-334eb3986c37 for instance with vm_state building and task_state spawning.
Aug 09 22:54:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "c17c9b77-8e04-432c-9634-c4bee2eb8889" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:54:42 user nova-compute[72409]: INFO nova.compute.claims [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Claim successful on node user
Aug 09 22:54:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-a7e9062a-e23a-4c55-8f87-f72c27d6185e req-4d69b7c8-85d8-4227-b364-2ee69673d30f service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a7e9062a-e23a-4c55-8f87-f72c27d6185e req-4d69b7c8-85d8-4227-b364-2ee69673d30f service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a7e9062a-e23a-4c55-8f87-f72c27d6185e req-4d69b7c8-85d8-4227-b364-2ee69673d30f service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a7e9062a-e23a-4c55-8f87-f72c27d6185e req-4d69b7c8-85d8-4227-b364-2ee69673d30f service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-a7e9062a-e23a-4c55-8f87-f72c27d6185e req-4d69b7c8-85d8-4227-b364-2ee69673d30f service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:43 user nova-compute[72409]: WARNING nova.compute.manager [req-a7e9062a-e23a-4c55-8f87-f72c27d6185e req-4d69b7c8-85d8-4227-b364-2ee69673d30f service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-d0512c07-7c8a-4e50-8a26-218871739981 for instance with vm_state building and task_state spawning.
Aug 09 22:54:43 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:54:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:54:43 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Creating image(s)
Aug 09 22:54:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "/opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "/opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.006s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "/opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG nova.policy [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28bd09bfc6304cb398964bbe964878bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37caf02dd0db418cbbdcd1d13349bd53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:54:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.394s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:44 user nova-compute[72409]: WARNING nova.compute.manager [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-c14ceb07-7e71-4723-88ff-482f29035aa0 for instance with vm_state building and task_state spawning.
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-c7073d80-257f-4127-823e-13f02e3997e3 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-c7073d80-257f-4127-823e-13f02e3997e3 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:44 user nova-compute[72409]: WARNING nova.compute.manager [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-c7073d80-257f-4127-823e-13f02e3997e3 for instance with vm_state building and task_state spawning.
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-c7073d80-257f-4127-823e-13f02e3997e3 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-c7073d80-257f-4127-823e-13f02e3997e3 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:44 user nova-compute[72409]: WARNING nova.compute.manager [req-a8c1c1ca-ff5b-4c42-8522-6dda6b3f7329 req-45d5062e-ba2a-4831-aca2-a03d58e16d48 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-c7073d80-257f-4127-823e-13f02e3997e3 for instance with vm_state building and task_state spawning.
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.172s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk 1073741824" returned: 0 in 0.100s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-5da1a50d-d954-4558-ab6a-334eb3986c37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-5da1a50d-d954-4558-ab6a-334eb3986c37 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:44 user nova-compute[72409]: WARNING nova.compute.manager [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-5da1a50d-d954-4558-ab6a-334eb3986c37 for instance with vm_state building and task_state spawning.
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:44 user nova-compute[72409]: WARNING nova.compute.manager [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-596e3df6-8719-490f-8f60-73578c9cf511 for instance with vm_state building and task_state spawning.
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:44 user nova-compute[72409]: WARNING nova.compute.manager [req-80c47169-f304-461d-8d5c-75e6aceacb7d req-4615ed58-7d2c-4b65-b29e-308ff5f5ccca service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-596e3df6-8719-490f-8f60-73578c9cf511 for instance with vm_state building and task_state spawning.
Aug 09 22:54:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.245s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:54:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Cannot resize image /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG nova.objects.instance [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lazy-loading 'migration_context' on Instance uuid c17c9b77-8e04-432c-9634-c4bee2eb8889 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Ensure instance console log exists: /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Successfully created port: eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-bc18960d-51ca-4740-8153-4fe0dd4f9451 req-61fd708a-3312-4f33-aff4-7ed4507709c5 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bc18960d-51ca-4740-8153-4fe0dd4f9451 req-61fd708a-3312-4f33-aff4-7ed4507709c5 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bc18960d-51ca-4740-8153-4fe0dd4f9451 req-61fd708a-3312-4f33-aff4-7ed4507709c5 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bc18960d-51ca-4740-8153-4fe0dd4f9451 req-61fd708a-3312-4f33-aff4-7ed4507709c5 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-bc18960d-51ca-4740-8153-4fe0dd4f9451 req-61fd708a-3312-4f33-aff4-7ed4507709c5 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:45 user nova-compute[72409]: WARNING nova.compute.manager [req-bc18960d-51ca-4740-8153-4fe0dd4f9451 req-61fd708a-3312-4f33-aff4-7ed4507709c5 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-d0512c07-7c8a-4e50-8a26-218871739981 for instance with vm_state building and task_state spawning.
Aug 09 22:54:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-8b5cf6df-b8e0-41c5-817f-0ea7b98b2361 req-3f3fe866-73e5-4011-bd59-ed40add68d3e service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8b5cf6df-b8e0-41c5-817f-0ea7b98b2361 req-3f3fe866-73e5-4011-bd59-ed40add68d3e service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8b5cf6df-b8e0-41c5-817f-0ea7b98b2361 req-3f3fe866-73e5-4011-bd59-ed40add68d3e service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8b5cf6df-b8e0-41c5-817f-0ea7b98b2361 req-3f3fe866-73e5-4011-bd59-ed40add68d3e service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-8b5cf6df-b8e0-41c5-817f-0ea7b98b2361 req-3f3fe866-73e5-4011-bd59-ed40add68d3e service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:46 user nova-compute[72409]: WARNING nova.compute.manager [req-8b5cf6df-b8e0-41c5-817f-0ea7b98b2361 req-3f3fe866-73e5-4011-bd59-ed40add68d3e service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-117c1972-75f2-4cd5-a229-53cd2361c506 for instance with vm_state building and task_state spawning.
Aug 09 22:54:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-8b5cf6df-b8e0-41c5-817f-0ea7b98b2361 req-3f3fe866-73e5-4011-bd59-ed40add68d3e service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8b5cf6df-b8e0-41c5-817f-0ea7b98b2361 req-3f3fe866-73e5-4011-bd59-ed40add68d3e service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8b5cf6df-b8e0-41c5-817f-0ea7b98b2361 req-3f3fe866-73e5-4011-bd59-ed40add68d3e service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8b5cf6df-b8e0-41c5-817f-0ea7b98b2361 req-3f3fe866-73e5-4011-bd59-ed40add68d3e service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-8b5cf6df-b8e0-41c5-817f-0ea7b98b2361 req-3f3fe866-73e5-4011-bd59-ed40add68d3e service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:46 user nova-compute[72409]: WARNING nova.compute.manager [req-8b5cf6df-b8e0-41c5-817f-0ea7b98b2361 req-3f3fe866-73e5-4011-bd59-ed40add68d3e service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-117c1972-75f2-4cd5-a229-53cd2361c506 for instance with vm_state building and task_state spawning.
Aug 09 22:54:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Successfully updated port: eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "refresh_cache-c17c9b77-8e04-432c-9634-c4bee2eb8889" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquired lock "refresh_cache-c17c9b77-8e04-432c-9634-c4bee2eb8889" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-257c460c-8463-4ea0-87b1-104a2d4991e8 req-b55ed584-d47e-410e-8b3b-a9d7dd26be17 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-257c460c-8463-4ea0-87b1-104a2d4991e8 req-b55ed584-d47e-410e-8b3b-a9d7dd26be17 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-257c460c-8463-4ea0-87b1-104a2d4991e8 req-b55ed584-d47e-410e-8b3b-a9d7dd26be17 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-257c460c-8463-4ea0-87b1-104a2d4991e8 req-b55ed584-d47e-410e-8b3b-a9d7dd26be17 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-257c460c-8463-4ea0-87b1-104a2d4991e8 req-b55ed584-d47e-410e-8b3b-a9d7dd26be17 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:46 user nova-compute[72409]: WARNING nova.compute.manager [req-257c460c-8463-4ea0-87b1-104a2d4991e8 req-b55ed584-d47e-410e-8b3b-a9d7dd26be17 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-49e29e6b-a887-425f-9eca-94a25bdb3301 for instance with vm_state building and task_state spawning.
Aug 09 22:54:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-257c460c-8463-4ea0-87b1-104a2d4991e8 req-b55ed584-d47e-410e-8b3b-a9d7dd26be17 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-257c460c-8463-4ea0-87b1-104a2d4991e8 req-b55ed584-d47e-410e-8b3b-a9d7dd26be17 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-257c460c-8463-4ea0-87b1-104a2d4991e8 req-b55ed584-d47e-410e-8b3b-a9d7dd26be17 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-257c460c-8463-4ea0-87b1-104a2d4991e8 req-b55ed584-d47e-410e-8b3b-a9d7dd26be17 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-257c460c-8463-4ea0-87b1-104a2d4991e8 req-b55ed584-d47e-410e-8b3b-a9d7dd26be17 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:46 user nova-compute[72409]: WARNING nova.compute.manager [req-257c460c-8463-4ea0-87b1-104a2d4991e8 req-b55ed584-d47e-410e-8b3b-a9d7dd26be17 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-49e29e6b-a887-425f-9eca-94a25bdb3301 for instance with vm_state building and task_state spawning.
Aug 09 22:54:46 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621687.0339406, f7f4be37-e516-4cd5-82bd-fa554f5e4c18 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:54:47 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] VM Resumed (Lifecycle Event)
Aug 09 22:54:47 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Instance spawned successfully.
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Updating instance_info_cache with network_info: [{"id": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "address": "fa:16:3e:a6:51:84", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb543e82-69", "ovs_interfaceid": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:47 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621687.0345762, f7f4be37-e516-4cd5-82bd-fa554f5e4c18 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:54:47 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] VM Started (Lifecycle Event)
Aug 09 22:54:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Releasing lock "refresh_cache-c17c9b77-8e04-432c-9634-c4bee2eb8889" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Instance network_info: |[{"id": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "address": "fa:16:3e:a6:51:84", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb543e82-69", "ovs_interfaceid": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Start _get_guest_xml network_info=[{"id": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "address": "fa:16:3e:a6:51:84", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb543e82-69", "ovs_interfaceid": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:47 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:54:47 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2101604991',display_name='tempest-ServersNegativeTestJSON-server-2101604991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2101604991',id=17,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37caf02dd0db418cbbdcd1d13349bd53',ramdisk_id='',reservation_id='r-x91vjhsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-648629170',owner_user_name='tempest-ServersNegativeTestJSON-648629170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:44Z,user_data=None,user_id='28bd09bfc6304cb398964bbe964878bf',uuid=c17c9b77-8e04-432c-9634-c4bee2eb8889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "address": "fa:16:3e:a6:51:84", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb543e82-69", "ovs_interfaceid": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Converting VIF {"id": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "address": "fa:16:3e:a6:51:84", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb543e82-69", "ovs_interfaceid": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:51:84,bridge_name='br-int',has_traffic_filtering=True,id=eb543e82-6921-47dd-9645-c8b7d78aa15e,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb543e82-69') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.objects.instance [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lazy-loading 'pci_devices' on Instance uuid c17c9b77-8e04-432c-9634-c4bee2eb8889 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:47 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:54:47 user nova-compute[72409]:   <uuid>c17c9b77-8e04-432c-9634-c4bee2eb8889</uuid>
Aug 09 22:54:47 user nova-compute[72409]:   <name>instance-00000011</name>
Aug 09 22:54:47 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:54:47 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:54:47 user nova-compute[72409]:   <metadata>
Aug 09 22:54:47 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:54:47 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:54:47 user nova-compute[72409]:       <nova:name>tempest-ServersNegativeTestJSON-server-2101604991</nova:name>
Aug 09 22:54:47 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:54:47</nova:creationTime>
Aug 09 22:54:47 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:54:47 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:54:47 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:54:47 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:54:47 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:54:47 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:54:47 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:54:47 user nova-compute[72409]:       <nova:owner>
Aug 09 22:54:47 user nova-compute[72409]:         <nova:user uuid="28bd09bfc6304cb398964bbe964878bf">tempest-ServersNegativeTestJSON-648629170-project-member</nova:user>
Aug 09 22:54:47 user nova-compute[72409]:         <nova:project uuid="37caf02dd0db418cbbdcd1d13349bd53">tempest-ServersNegativeTestJSON-648629170</nova:project>
Aug 09 22:54:47 user nova-compute[72409]:       </nova:owner>
Aug 09 22:54:47 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:54:47 user nova-compute[72409]:       <nova:ports>
Aug 09 22:54:47 user nova-compute[72409]:         <nova:port uuid="eb543e82-6921-47dd-9645-c8b7d78aa15e">
Aug 09 22:54:47 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 22:54:47 user nova-compute[72409]:         </nova:port>
Aug 09 22:54:47 user nova-compute[72409]:       </nova:ports>
Aug 09 22:54:47 user nova-compute[72409]:     </nova:instance>
Aug 09 22:54:47 user nova-compute[72409]:   </metadata>
Aug 09 22:54:47 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:54:47 user nova-compute[72409]:     <system>
Aug 09 22:54:47 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:54:47 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:54:47 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:54:47 user nova-compute[72409]:       <entry name="serial">c17c9b77-8e04-432c-9634-c4bee2eb8889</entry>
Aug 09 22:54:47 user nova-compute[72409]:       <entry name="uuid">c17c9b77-8e04-432c-9634-c4bee2eb8889</entry>
Aug 09 22:54:47 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:54:47 user nova-compute[72409]:     </system>
Aug 09 22:54:47 user nova-compute[72409]:   </sysinfo>
Aug 09 22:54:47 user nova-compute[72409]:   <os>
Aug 09 22:54:47 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:54:47 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:54:47 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:54:47 user nova-compute[72409]:   </os>
Aug 09 22:54:47 user nova-compute[72409]:   <features>
Aug 09 22:54:47 user nova-compute[72409]:     <acpi/>
Aug 09 22:54:47 user nova-compute[72409]:     <apic/>
Aug 09 22:54:47 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:54:47 user nova-compute[72409]:   </features>
Aug 09 22:54:47 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:54:47 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:54:47 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:54:47 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:54:47 user nova-compute[72409]:   </clock>
Aug 09 22:54:47 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:54:47 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:54:47 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:54:47 user nova-compute[72409]:   </cpu>
Aug 09 22:54:47 user nova-compute[72409]:   <devices>
Aug 09 22:54:47 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:54:47 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:54:47 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk"/>
Aug 09 22:54:47 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:54:47 user nova-compute[72409]:     </disk>
Aug 09 22:54:47 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:54:47 user nova-compute[72409]:       <mac address="fa:16:3e:a6:51:84"/>
Aug 09 22:54:47 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:47 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:54:47 user nova-compute[72409]:       <target dev="tapeb543e82-69"/>
Aug 09 22:54:47 user nova-compute[72409]:     </interface>
Aug 09 22:54:47 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:54:47 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/console.log" append="off"/>
Aug 09 22:54:47 user nova-compute[72409]:     </serial>
Aug 09 22:54:47 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:54:47 user nova-compute[72409]:     <video>
Aug 09 22:54:47 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:54:47 user nova-compute[72409]:     </video>
Aug 09 22:54:47 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:54:47 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:54:47 user nova-compute[72409]:     </rng>
Aug 09 22:54:47 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:54:47 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:54:47 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:54:47 user nova-compute[72409]:     </memballoon>
Aug 09 22:54:47 user nova-compute[72409]:   </devices>
Aug 09 22:54:47 user nova-compute[72409]: </domain>
Aug 09 22:54:47 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2101604991',display_name='tempest-ServersNegativeTestJSON-server-2101604991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2101604991',id=17,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37caf02dd0db418cbbdcd1d13349bd53',ramdisk_id='',reservation_id='r-x91vjhsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-648629170',owner_user_name='tempest-ServersNegativeTestJSON-648629170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:54:44Z,user_data=None,user_id='28bd09bfc6304cb398964bbe964878bf',uuid=c17c9b77-8e04-432c-9634-c4bee2eb8889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "address": "fa:16:3e:a6:51:84", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb543e82-69", "ovs_interfaceid": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Converting VIF {"id": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "address": "fa:16:3e:a6:51:84", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb543e82-69", "ovs_interfaceid": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:51:84,bridge_name='br-int',has_traffic_filtering=True,id=eb543e82-6921-47dd-9645-c8b7d78aa15e,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb543e82-69') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG os_vif [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:51:84,bridge_name='br-int',has_traffic_filtering=True,id=eb543e82-6921-47dd-9645-c8b7d78aa15e,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb543e82-69') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:54:47 user nova-compute[72409]: INFO nova.compute.manager [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Took 13.22 seconds to spawn the instance on the hypervisor.
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb543e82-69, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb543e82-69, col_values=(('external_ids', {'iface-id': 'eb543e82-6921-47dd-9645-c8b7d78aa15e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:51:84', 'vm-uuid': 'c17c9b77-8e04-432c-9634-c4bee2eb8889'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:47 user nova-compute[72409]: INFO os_vif [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:51:84,bridge_name='br-int',has_traffic_filtering=True,id=eb543e82-6921-47dd-9645-c8b7d78aa15e,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb543e82-69')
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:54:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] No VIF found with MAC fa:16:3e:a6:51:84, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:54:47 user nova-compute[72409]: INFO nova.compute.manager [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Took 47.41 seconds to build instance.
Aug 09 22:54:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fedaf01-e8d2-4b08-a3eb-6b5f383969d6 tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.523s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:48 user nova-compute[72409]: DEBUG nova.compute.manager [req-aa1bf310-f0c0-492f-91ce-77362a1b3abb req-74a62eae-cfad-416b-a6e2-e9cc5e1807dc service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Received event network-changed-eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:48 user nova-compute[72409]: DEBUG nova.compute.manager [req-aa1bf310-f0c0-492f-91ce-77362a1b3abb req-74a62eae-cfad-416b-a6e2-e9cc5e1807dc service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Refreshing instance network info cache due to event network-changed-eb543e82-6921-47dd-9645-c8b7d78aa15e. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:54:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aa1bf310-f0c0-492f-91ce-77362a1b3abb req-74a62eae-cfad-416b-a6e2-e9cc5e1807dc service nova] Acquiring lock "refresh_cache-c17c9b77-8e04-432c-9634-c4bee2eb8889" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aa1bf310-f0c0-492f-91ce-77362a1b3abb req-74a62eae-cfad-416b-a6e2-e9cc5e1807dc service nova] Acquired lock "refresh_cache-c17c9b77-8e04-432c-9634-c4bee2eb8889" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:48 user nova-compute[72409]: DEBUG nova.network.neutron [req-aa1bf310-f0c0-492f-91ce-77362a1b3abb req-74a62eae-cfad-416b-a6e2-e9cc5e1807dc service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Refreshing network info cache for port eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:54:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:49 user nova-compute[72409]: DEBUG nova.network.neutron [req-aa1bf310-f0c0-492f-91ce-77362a1b3abb req-74a62eae-cfad-416b-a6e2-e9cc5e1807dc service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Updated VIF entry in instance network info cache for port eb543e82-6921-47dd-9645-c8b7d78aa15e. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:54:49 user nova-compute[72409]: DEBUG nova.network.neutron [req-aa1bf310-f0c0-492f-91ce-77362a1b3abb req-74a62eae-cfad-416b-a6e2-e9cc5e1807dc service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Updating instance_info_cache with network_info: [{"id": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "address": "fa:16:3e:a6:51:84", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb543e82-69", "ovs_interfaceid": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aa1bf310-f0c0-492f-91ce-77362a1b3abb req-74a62eae-cfad-416b-a6e2-e9cc5e1807dc service nova] Releasing lock "refresh_cache-c17c9b77-8e04-432c-9634-c4bee2eb8889" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-2b2c0506-d712-4e46-a8fe-d0ab165732f0 req-2ab48b16-d428-458f-9c7c-2d12a8411fa0 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Received event network-vif-plugged-eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2b2c0506-d712-4e46-a8fe-d0ab165732f0 req-2ab48b16-d428-458f-9c7c-2d12a8411fa0 service nova] Acquiring lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2b2c0506-d712-4e46-a8fe-d0ab165732f0 req-2ab48b16-d428-458f-9c7c-2d12a8411fa0 service nova] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2b2c0506-d712-4e46-a8fe-d0ab165732f0 req-2ab48b16-d428-458f-9c7c-2d12a8411fa0 service nova] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-2b2c0506-d712-4e46-a8fe-d0ab165732f0 req-2ab48b16-d428-458f-9c7c-2d12a8411fa0 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] No waiting events found dispatching network-vif-plugged-eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:50 user nova-compute[72409]: WARNING nova.compute.manager [req-2b2c0506-d712-4e46-a8fe-d0ab165732f0 req-2ab48b16-d428-458f-9c7c-2d12a8411fa0 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Received unexpected event network-vif-plugged-eb543e82-6921-47dd-9645-c8b7d78aa15e for instance with vm_state building and task_state spawning.
Aug 09 22:54:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-2b2c0506-d712-4e46-a8fe-d0ab165732f0 req-2ab48b16-d428-458f-9c7c-2d12a8411fa0 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Received event network-vif-plugged-eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:54:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2b2c0506-d712-4e46-a8fe-d0ab165732f0 req-2ab48b16-d428-458f-9c7c-2d12a8411fa0 service nova] Acquiring lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2b2c0506-d712-4e46-a8fe-d0ab165732f0 req-2ab48b16-d428-458f-9c7c-2d12a8411fa0 service nova] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2b2c0506-d712-4e46-a8fe-d0ab165732f0 req-2ab48b16-d428-458f-9c7c-2d12a8411fa0 service nova] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-2b2c0506-d712-4e46-a8fe-d0ab165732f0 req-2ab48b16-d428-458f-9c7c-2d12a8411fa0 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] No waiting events found dispatching network-vif-plugged-eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:54:50 user nova-compute[72409]: WARNING nova.compute.manager [req-2b2c0506-d712-4e46-a8fe-d0ab165732f0 req-2ab48b16-d428-458f-9c7c-2d12a8411fa0 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Received unexpected event network-vif-plugged-eb543e82-6921-47dd-9645-c8b7d78aa15e for instance with vm_state building and task_state spawning.
Aug 09 22:54:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621691.4870534, c17c9b77-8e04-432c-9634-c4bee2eb8889 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:54:51 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] VM Resumed (Lifecycle Event)
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:54:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Instance spawned successfully.
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:54:51 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621691.4883294, c17c9b77-8e04-432c-9634-c4bee2eb8889 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:54:51 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] VM Started (Lifecycle Event)
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:54:51 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621676.7530606, 29a04807-1c46-4546-b78c-73d4f2b86c46 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:54:51 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] VM Stopped (Lifecycle Event)
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e79113e1-2491-48fe-a6e1-39f168f82d9e None None] [instance: 29a04807-1c46-4546-b78c-73d4f2b86c46] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:51 user nova-compute[72409]: INFO nova.compute.manager [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Took 7.98 seconds to spawn the instance on the hypervisor.
Aug 09 22:54:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:54:52 user nova-compute[72409]: INFO nova.compute.manager [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Took 9.19 seconds to build instance.
Aug 09 22:54:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3593b31a-0b67-4271-a116-72c1701d63d7 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.396s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:55 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:54:55 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:54:55 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:54:55 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 22:54:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:54:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:54:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 22:54:55 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 935c4677-a511-4b0e-aef3-57bc036220ab {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Updating instance_info_cache with network_info: [{"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:54:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:54:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:54:59 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:54:59 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:54:59 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7681MB free_disk=25.66704559326172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:54:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:54:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5af7f4c7-5937-4b69-831e-941d7de4417d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 1f17088d-95df-44c9-aac2-24eced6fde25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5b7906a3-e02b-49a3-9a56-fc34a8730238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance f7f4be37-e516-4cd5-82bd-fa554f5e4c18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c17c9b77-8e04-432c-9634-c4bee2eb8889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:55:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "122c668a-56c6-46b0-9e1f-2f39bdea7418" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:55:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:11 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:55:11 user nova-compute[72409]: INFO nova.compute.claims [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Claim successful on node user
Aug 09 22:55:11 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:55:11 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG nova.network.neutron [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:55:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:55:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG nova.policy [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fa331e6178145b5b9a0d07a4b4a4d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa953a0836e54254a4917555ccf838a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:55:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Creating image(s)
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "/opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "/opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "/opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.168s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.184s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk 1073741824" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.166s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Cannot resize image /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG nova.objects.instance [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lazy-loading 'migration_context' on Instance uuid 122c668a-56c6-46b0-9e1f-2f39bdea7418 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Ensure instance console log exists: /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG nova.network.neutron [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Successfully created port: 591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:55:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Successfully updated port: 591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "refresh_cache-122c668a-56c6-46b0-9e1f-2f39bdea7418" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquired lock "refresh_cache-122c668a-56c6-46b0-9e1f-2f39bdea7418" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-46afb9cd-acdc-4e1a-9b39-809fd550dc0a req-c11caf26-b296-4947-a28b-9101bebd3714 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Received event network-changed-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-46afb9cd-acdc-4e1a-9b39-809fd550dc0a req-c11caf26-b296-4947-a28b-9101bebd3714 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Refreshing instance network info cache due to event network-changed-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-46afb9cd-acdc-4e1a-9b39-809fd550dc0a req-c11caf26-b296-4947-a28b-9101bebd3714 service nova] Acquiring lock "refresh_cache-122c668a-56c6-46b0-9e1f-2f39bdea7418" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Updating instance_info_cache with network_info: [{"id": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "address": "fa:16:3e:49:d2:84", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591d4f95-4e", "ovs_interfaceid": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Releasing lock "refresh_cache-122c668a-56c6-46b0-9e1f-2f39bdea7418" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG nova.compute.manager [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Instance network_info: |[{"id": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "address": "fa:16:3e:49:d2:84", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591d4f95-4e", "ovs_interfaceid": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-46afb9cd-acdc-4e1a-9b39-809fd550dc0a req-c11caf26-b296-4947-a28b-9101bebd3714 service nova] Acquired lock "refresh_cache-122c668a-56c6-46b0-9e1f-2f39bdea7418" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG nova.network.neutron [req-46afb9cd-acdc-4e1a-9b39-809fd550dc0a req-c11caf26-b296-4947-a28b-9101bebd3714 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Refreshing network info cache for port 591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Start _get_guest_xml network_info=[{"id": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "address": "fa:16:3e:49:d2:84", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591d4f95-4e", "ovs_interfaceid": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:55:14 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:55:14 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:55:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:55:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:55:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-808866618',display_name='tempest-VolumesActionsTest-instance-808866618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-808866618',id=18,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa953a0836e54254a4917555ccf838a1',ramdisk_id='',reservation_id='r-2lmlxztr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-24018393',owner_user_name='tempest-VolumesActionsTest-24018393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:55:12Z,user_data=None,user_id='8fa331e6178145b5b9a0d07a4b4a4d63',uuid=122c668a-56c6-46b0-9e1f-2f39bdea7418,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "address": "fa:16:3e:49:d2:84", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591d4f95-4e", "ovs_interfaceid": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Converting VIF {"id": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "address": "fa:16:3e:49:d2:84", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591d4f95-4e", "ovs_interfaceid": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591d4f95-4e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.objects.instance [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lazy-loading 'pci_devices' on Instance uuid 122c668a-56c6-46b0-9e1f-2f39bdea7418 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:55:15 user nova-compute[72409]:   <uuid>122c668a-56c6-46b0-9e1f-2f39bdea7418</uuid>
Aug 09 22:55:15 user nova-compute[72409]:   <name>instance-00000012</name>
Aug 09 22:55:15 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:55:15 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:55:15 user nova-compute[72409]:   <metadata>
Aug 09 22:55:15 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:55:15 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:55:15 user nova-compute[72409]:       <nova:name>tempest-VolumesActionsTest-instance-808866618</nova:name>
Aug 09 22:55:15 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:55:14</nova:creationTime>
Aug 09 22:55:15 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:55:15 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:55:15 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:55:15 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:55:15 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:55:15 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:55:15 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:55:15 user nova-compute[72409]:       <nova:owner>
Aug 09 22:55:15 user nova-compute[72409]:         <nova:user uuid="8fa331e6178145b5b9a0d07a4b4a4d63">tempest-VolumesActionsTest-24018393-project-member</nova:user>
Aug 09 22:55:15 user nova-compute[72409]:         <nova:project uuid="aa953a0836e54254a4917555ccf838a1">tempest-VolumesActionsTest-24018393</nova:project>
Aug 09 22:55:15 user nova-compute[72409]:       </nova:owner>
Aug 09 22:55:15 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:55:15 user nova-compute[72409]:       <nova:ports>
Aug 09 22:55:15 user nova-compute[72409]:         <nova:port uuid="591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725">
Aug 09 22:55:15 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 22:55:15 user nova-compute[72409]:         </nova:port>
Aug 09 22:55:15 user nova-compute[72409]:       </nova:ports>
Aug 09 22:55:15 user nova-compute[72409]:     </nova:instance>
Aug 09 22:55:15 user nova-compute[72409]:   </metadata>
Aug 09 22:55:15 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:55:15 user nova-compute[72409]:     <system>
Aug 09 22:55:15 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:55:15 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:55:15 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:55:15 user nova-compute[72409]:       <entry name="serial">122c668a-56c6-46b0-9e1f-2f39bdea7418</entry>
Aug 09 22:55:15 user nova-compute[72409]:       <entry name="uuid">122c668a-56c6-46b0-9e1f-2f39bdea7418</entry>
Aug 09 22:55:15 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:55:15 user nova-compute[72409]:     </system>
Aug 09 22:55:15 user nova-compute[72409]:   </sysinfo>
Aug 09 22:55:15 user nova-compute[72409]:   <os>
Aug 09 22:55:15 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:55:15 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:55:15 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:55:15 user nova-compute[72409]:   </os>
Aug 09 22:55:15 user nova-compute[72409]:   <features>
Aug 09 22:55:15 user nova-compute[72409]:     <acpi/>
Aug 09 22:55:15 user nova-compute[72409]:     <apic/>
Aug 09 22:55:15 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:55:15 user nova-compute[72409]:   </features>
Aug 09 22:55:15 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:55:15 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:55:15 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:55:15 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:55:15 user nova-compute[72409]:   </clock>
Aug 09 22:55:15 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:55:15 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:55:15 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:55:15 user nova-compute[72409]:   </cpu>
Aug 09 22:55:15 user nova-compute[72409]:   <devices>
Aug 09 22:55:15 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:55:15 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:55:15 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk"/>
Aug 09 22:55:15 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:55:15 user nova-compute[72409]:     </disk>
Aug 09 22:55:15 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:55:15 user nova-compute[72409]:       <mac address="fa:16:3e:49:d2:84"/>
Aug 09 22:55:15 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:55:15 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:55:15 user nova-compute[72409]:       <target dev="tap591d4f95-4e"/>
Aug 09 22:55:15 user nova-compute[72409]:     </interface>
Aug 09 22:55:15 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:55:15 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/console.log" append="off"/>
Aug 09 22:55:15 user nova-compute[72409]:     </serial>
Aug 09 22:55:15 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:55:15 user nova-compute[72409]:     <video>
Aug 09 22:55:15 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:55:15 user nova-compute[72409]:     </video>
Aug 09 22:55:15 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:55:15 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:55:15 user nova-compute[72409]:     </rng>
Aug 09 22:55:15 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:55:15 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:55:15 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:55:15 user nova-compute[72409]:     </memballoon>
Aug 09 22:55:15 user nova-compute[72409]:   </devices>
Aug 09 22:55:15 user nova-compute[72409]: </domain>
Aug 09 22:55:15 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:55:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-808866618',display_name='tempest-VolumesActionsTest-instance-808866618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-808866618',id=18,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa953a0836e54254a4917555ccf838a1',ramdisk_id='',reservation_id='r-2lmlxztr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-24018393',owner_user_name='tempest-VolumesActionsTest-24018393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:55:12Z,user_data=None,user_id='8fa331e6178145b5b9a0d07a4b4a4d63',uuid=122c668a-56c6-46b0-9e1f-2f39bdea7418,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "address": "fa:16:3e:49:d2:84", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591d4f95-4e", "ovs_interfaceid": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Converting VIF {"id": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "address": "fa:16:3e:49:d2:84", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591d4f95-4e", "ovs_interfaceid": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591d4f95-4e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG os_vif [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591d4f95-4e') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap591d4f95-4e, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap591d4f95-4e, col_values=(('external_ids', {'iface-id': '591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:d2:84', 'vm-uuid': '122c668a-56c6-46b0-9e1f-2f39bdea7418'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:15 user nova-compute[72409]: INFO os_vif [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591d4f95-4e')
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] No VIF found with MAC fa:16:3e:49:d2:84, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.network.neutron [req-46afb9cd-acdc-4e1a-9b39-809fd550dc0a req-c11caf26-b296-4947-a28b-9101bebd3714 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Updated VIF entry in instance network info cache for port 591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG nova.network.neutron [req-46afb9cd-acdc-4e1a-9b39-809fd550dc0a req-c11caf26-b296-4947-a28b-9101bebd3714 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Updating instance_info_cache with network_info: [{"id": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "address": "fa:16:3e:49:d2:84", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591d4f95-4e", "ovs_interfaceid": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:55:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-46afb9cd-acdc-4e1a-9b39-809fd550dc0a req-c11caf26-b296-4947-a28b-9101bebd3714 service nova] Releasing lock "refresh_cache-122c668a-56c6-46b0-9e1f-2f39bdea7418" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:55:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "c513e397-28f7-4d93-8487-257becbef9d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-4d9d8157-5e26-4d88-8e31-bd63107b8efb req-95f70e94-bec1-451e-bbd6-8a2c376b5b7d service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Received event network-vif-plugged-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4d9d8157-5e26-4d88-8e31-bd63107b8efb req-95f70e94-bec1-451e-bbd6-8a2c376b5b7d service nova] Acquiring lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4d9d8157-5e26-4d88-8e31-bd63107b8efb req-95f70e94-bec1-451e-bbd6-8a2c376b5b7d service nova] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4d9d8157-5e26-4d88-8e31-bd63107b8efb req-95f70e94-bec1-451e-bbd6-8a2c376b5b7d service nova] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-4d9d8157-5e26-4d88-8e31-bd63107b8efb req-95f70e94-bec1-451e-bbd6-8a2c376b5b7d service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] No waiting events found dispatching network-vif-plugged-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:17 user nova-compute[72409]: WARNING nova.compute.manager [req-4d9d8157-5e26-4d88-8e31-bd63107b8efb req-95f70e94-bec1-451e-bbd6-8a2c376b5b7d service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Received unexpected event network-vif-plugged-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 for instance with vm_state building and task_state spawning.
Aug 09 22:55:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:17 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:55:17 user nova-compute[72409]: INFO nova.compute.claims [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Claim successful on node user
Aug 09 22:55:18 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:55:18 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:55:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG nova.policy [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd662607342934fb7babc31e155f5d915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a302bac664904169ad012943400598db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:55:18 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Creating image(s)
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "/opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "/opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "/opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.188s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk 1073741824" returned: 0 in 0.055s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.185s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:55:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Successfully created port: 6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Cannot resize image /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'migration_context' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Ensure instance console log exists: /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.compute.manager [req-77f3164c-be72-4209-8813-d184801b6eda req-f27fb492-ba62-4d71-90ca-04aaa04cd499 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Received event network-vif-plugged-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-77f3164c-be72-4209-8813-d184801b6eda req-f27fb492-ba62-4d71-90ca-04aaa04cd499 service nova] Acquiring lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-77f3164c-be72-4209-8813-d184801b6eda req-f27fb492-ba62-4d71-90ca-04aaa04cd499 service nova] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-77f3164c-be72-4209-8813-d184801b6eda req-f27fb492-ba62-4d71-90ca-04aaa04cd499 service nova] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.compute.manager [req-77f3164c-be72-4209-8813-d184801b6eda req-f27fb492-ba62-4d71-90ca-04aaa04cd499 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] No waiting events found dispatching network-vif-plugged-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:19 user nova-compute[72409]: WARNING nova.compute.manager [req-77f3164c-be72-4209-8813-d184801b6eda req-f27fb492-ba62-4d71-90ca-04aaa04cd499 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Received unexpected event network-vif-plugged-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 for instance with vm_state building and task_state spawning.
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621719.3356934, 122c668a-56c6-46b0-9e1f-2f39bdea7418 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:55:19 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] VM Resumed (Lifecycle Event)
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:55:19 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Instance spawned successfully.
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:55:19 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621719.3383114, 122c668a-56c6-46b0-9e1f-2f39bdea7418 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:55:19 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] VM Started (Lifecycle Event)
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:55:19 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:55:19 user nova-compute[72409]: INFO nova.compute.manager [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Took 7.15 seconds to spawn the instance on the hypervisor.
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:55:19 user nova-compute[72409]: INFO nova.compute.manager [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Took 8.07 seconds to build instance.
Aug 09 22:55:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-050f8e1f-94fc-495a-af7b-2b22990d775e tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.180s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Successfully updated port: 6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquired lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.compute.manager [req-514c2b87-2468-4edf-a539-cb26bbed854f req-00d59e28-f1e6-47d2-8a74-e5467ed214ee service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-changed-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.compute.manager [req-514c2b87-2468-4edf-a539-cb26bbed854f req-00d59e28-f1e6-47d2-8a74-e5467ed214ee service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Refreshing instance network info cache due to event network-changed-6afaf787-02f9-400f-b7a9-b0aa4df58939. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-514c2b87-2468-4edf-a539-cb26bbed854f req-00d59e28-f1e6-47d2-8a74-e5467ed214ee service nova] Acquiring lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:55:19 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating instance_info_cache with network_info: [{"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Releasing lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Instance network_info: |[{"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-514c2b87-2468-4edf-a539-cb26bbed854f req-00d59e28-f1e6-47d2-8a74-e5467ed214ee service nova] Acquired lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.network.neutron [req-514c2b87-2468-4edf-a539-cb26bbed854f req-00d59e28-f1e6-47d2-8a74-e5467ed214ee service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Refreshing network info cache for port 6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Start _get_guest_xml network_info=[{"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:55:20 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:55:20 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2097419676',display_name='tempest-ServerActionsTestOtherB-server-2097419676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2097419676',id=19,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDelHCC8nFCHRTmFXWR19BOOB/f+NPR90u8i8YXxlReJTIRJmpJsKKUPRbCWzHe6UX+HR9F8ZTKdA6A0YGmKOztUWCiwbCDEi2c3eCmLXAc66rx+Q4ob5pL4kfTx6LhQUg==',key_name='tempest-keypair-351454578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a302bac664904169ad012943400598db',ramdisk_id='',reservation_id='r-pfgn9xa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-68548202',owner_user_name='tempest-ServerActionsTestOtherB-68548202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:55:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d662607342934fb7babc31e155f5d915',uuid=c513e397-28f7-4d93-8487-257becbef9d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converting VIF {"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'pci_devices' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:55:20 user nova-compute[72409]:   <uuid>c513e397-28f7-4d93-8487-257becbef9d3</uuid>
Aug 09 22:55:20 user nova-compute[72409]:   <name>instance-00000013</name>
Aug 09 22:55:20 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:55:20 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:55:20 user nova-compute[72409]:   <metadata>
Aug 09 22:55:20 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:55:20 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:55:20 user nova-compute[72409]:       <nova:name>tempest-ServerActionsTestOtherB-server-2097419676</nova:name>
Aug 09 22:55:20 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:55:20</nova:creationTime>
Aug 09 22:55:20 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:55:20 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:55:20 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:55:20 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:55:20 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:55:20 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:55:20 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:55:20 user nova-compute[72409]:       <nova:owner>
Aug 09 22:55:20 user nova-compute[72409]:         <nova:user uuid="d662607342934fb7babc31e155f5d915">tempest-ServerActionsTestOtherB-68548202-project-member</nova:user>
Aug 09 22:55:20 user nova-compute[72409]:         <nova:project uuid="a302bac664904169ad012943400598db">tempest-ServerActionsTestOtherB-68548202</nova:project>
Aug 09 22:55:20 user nova-compute[72409]:       </nova:owner>
Aug 09 22:55:20 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:55:20 user nova-compute[72409]:       <nova:ports>
Aug 09 22:55:20 user nova-compute[72409]:         <nova:port uuid="6afaf787-02f9-400f-b7a9-b0aa4df58939">
Aug 09 22:55:20 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 22:55:20 user nova-compute[72409]:         </nova:port>
Aug 09 22:55:20 user nova-compute[72409]:       </nova:ports>
Aug 09 22:55:20 user nova-compute[72409]:     </nova:instance>
Aug 09 22:55:20 user nova-compute[72409]:   </metadata>
Aug 09 22:55:20 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:55:20 user nova-compute[72409]:     <system>
Aug 09 22:55:20 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:55:20 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:55:20 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:55:20 user nova-compute[72409]:       <entry name="serial">c513e397-28f7-4d93-8487-257becbef9d3</entry>
Aug 09 22:55:20 user nova-compute[72409]:       <entry name="uuid">c513e397-28f7-4d93-8487-257becbef9d3</entry>
Aug 09 22:55:20 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:55:20 user nova-compute[72409]:     </system>
Aug 09 22:55:20 user nova-compute[72409]:   </sysinfo>
Aug 09 22:55:20 user nova-compute[72409]:   <os>
Aug 09 22:55:20 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:55:20 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:55:20 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:55:20 user nova-compute[72409]:   </os>
Aug 09 22:55:20 user nova-compute[72409]:   <features>
Aug 09 22:55:20 user nova-compute[72409]:     <acpi/>
Aug 09 22:55:20 user nova-compute[72409]:     <apic/>
Aug 09 22:55:20 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:55:20 user nova-compute[72409]:   </features>
Aug 09 22:55:20 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:55:20 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:55:20 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:55:20 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:55:20 user nova-compute[72409]:   </clock>
Aug 09 22:55:20 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:55:20 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:55:20 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:55:20 user nova-compute[72409]:   </cpu>
Aug 09 22:55:20 user nova-compute[72409]:   <devices>
Aug 09 22:55:20 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:55:20 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:55:20 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk"/>
Aug 09 22:55:20 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:55:20 user nova-compute[72409]:     </disk>
Aug 09 22:55:20 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:55:20 user nova-compute[72409]:       <mac address="fa:16:3e:26:c6:8e"/>
Aug 09 22:55:20 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:55:20 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:55:20 user nova-compute[72409]:       <target dev="tap6afaf787-02"/>
Aug 09 22:55:20 user nova-compute[72409]:     </interface>
Aug 09 22:55:20 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:55:20 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/console.log" append="off"/>
Aug 09 22:55:20 user nova-compute[72409]:     </serial>
Aug 09 22:55:20 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:55:20 user nova-compute[72409]:     <video>
Aug 09 22:55:20 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:55:20 user nova-compute[72409]:     </video>
Aug 09 22:55:20 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:55:20 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:55:20 user nova-compute[72409]:     </rng>
Aug 09 22:55:20 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:55:20 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:55:20 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:55:20 user nova-compute[72409]:     </memballoon>
Aug 09 22:55:20 user nova-compute[72409]:   </devices>
Aug 09 22:55:20 user nova-compute[72409]: </domain>
Aug 09 22:55:20 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2097419676',display_name='tempest-ServerActionsTestOtherB-server-2097419676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2097419676',id=19,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDelHCC8nFCHRTmFXWR19BOOB/f+NPR90u8i8YXxlReJTIRJmpJsKKUPRbCWzHe6UX+HR9F8ZTKdA6A0YGmKOztUWCiwbCDEi2c3eCmLXAc66rx+Q4ob5pL4kfTx6LhQUg==',key_name='tempest-keypair-351454578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a302bac664904169ad012943400598db',ramdisk_id='',reservation_id='r-pfgn9xa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-68548202',owner_user_name='tempest-ServerActionsTestOtherB-68548202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:55:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d662607342934fb7babc31e155f5d915',uuid=c513e397-28f7-4d93-8487-257becbef9d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converting VIF {"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG os_vif [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6afaf787-02, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6afaf787-02, col_values=(('external_ids', {'iface-id': '6afaf787-02f9-400f-b7a9-b0aa4df58939', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:c6:8e', 'vm-uuid': 'c513e397-28f7-4d93-8487-257becbef9d3'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:20 user nova-compute[72409]: INFO os_vif [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02')
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] No VIF found with MAC fa:16:3e:26:c6:8e, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.network.neutron [req-514c2b87-2468-4edf-a539-cb26bbed854f req-00d59e28-f1e6-47d2-8a74-e5467ed214ee service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updated VIF entry in instance network info cache for port 6afaf787-02f9-400f-b7a9-b0aa4df58939. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG nova.network.neutron [req-514c2b87-2468-4edf-a539-cb26bbed854f req-00d59e28-f1e6-47d2-8a74-e5467ed214ee service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating instance_info_cache with network_info: [{"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:55:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-514c2b87-2468-4edf-a539-cb26bbed854f req-00d59e28-f1e6-47d2-8a74-e5467ed214ee service nova] Releasing lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:55:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-1c9c2620-5d07-4edc-bc61-d5dbbb095093 req-2efa02cb-fd95-4b9e-99c4-2cb4581fad61 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1c9c2620-5d07-4edc-bc61-d5dbbb095093 req-2efa02cb-fd95-4b9e-99c4-2cb4581fad61 service nova] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1c9c2620-5d07-4edc-bc61-d5dbbb095093 req-2efa02cb-fd95-4b9e-99c4-2cb4581fad61 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1c9c2620-5d07-4edc-bc61-d5dbbb095093 req-2efa02cb-fd95-4b9e-99c4-2cb4581fad61 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-1c9c2620-5d07-4edc-bc61-d5dbbb095093 req-2efa02cb-fd95-4b9e-99c4-2cb4581fad61 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] No waiting events found dispatching network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:22 user nova-compute[72409]: WARNING nova.compute.manager [req-1c9c2620-5d07-4edc-bc61-d5dbbb095093 req-2efa02cb-fd95-4b9e-99c4-2cb4581fad61 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received unexpected event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 for instance with vm_state building and task_state spawning.
Aug 09 22:55:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.compute.manager [req-32308fb6-315c-46d0-9505-b4663dc9847f req-4005b813-8f2f-4ca6-afe1-ff88b9bad71f service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-32308fb6-315c-46d0-9505-b4663dc9847f req-4005b813-8f2f-4ca6-afe1-ff88b9bad71f service nova] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-32308fb6-315c-46d0-9505-b4663dc9847f req-4005b813-8f2f-4ca6-afe1-ff88b9bad71f service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-32308fb6-315c-46d0-9505-b4663dc9847f req-4005b813-8f2f-4ca6-afe1-ff88b9bad71f service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.compute.manager [req-32308fb6-315c-46d0-9505-b4663dc9847f req-4005b813-8f2f-4ca6-afe1-ff88b9bad71f service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] No waiting events found dispatching network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:24 user nova-compute[72409]: WARNING nova.compute.manager [req-32308fb6-315c-46d0-9505-b4663dc9847f req-4005b813-8f2f-4ca6-afe1-ff88b9bad71f service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received unexpected event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 for instance with vm_state building and task_state spawning.
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621724.4798431, c513e397-28f7-4d93-8487-257becbef9d3 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:55:24 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] VM Resumed (Lifecycle Event)
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:55:24 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Instance spawned successfully.
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:55:24 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621724.4828286, c513e397-28f7-4d93-8487-257becbef9d3 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:55:24 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] VM Started (Lifecycle Event)
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:55:24 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:55:24 user nova-compute[72409]: INFO nova.compute.manager [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 09 22:55:24 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:55:24 user nova-compute[72409]: INFO nova.compute.manager [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Took 7.20 seconds to build instance.
Aug 09 22:55:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6ace798-cc2c-4364-9b79-8d6cfe6a3f59 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "c513e397-28f7-4d93-8487-257becbef9d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.683s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "1f17088d-95df-44c9-aac2-24eced6fde25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "1f17088d-95df-44c9-aac2-24eced6fde25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:35 user nova-compute[72409]: INFO nova.compute.manager [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Terminating instance
Aug 09 22:55:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:55:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:36 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Instance destroyed successfully.
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.objects.instance [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lazy-loading 'resources' on Instance uuid 1f17088d-95df-44c9-aac2-24eced6fde25 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:53:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-623150734',display_name='tempest-VolumesAdminNegativeTest-server-623150734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-623150734',id=13,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:53:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3700dd59a4548ca8e2ec8dd02ecc6a7',ramdisk_id='',reservation_id='r-4qvzlmvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-994899237',owner_user_name='tempest-VolumesAdminNegativeTest-994899237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:53:42Z,user_data=None,user_id='5567e41fceda4b8abf8d8d56a8bab9b2',uuid=1f17088d-95df-44c9-aac2-24eced6fde25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "address": "fa:16:3e:71:83:eb", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fcb0c2-e9", "ovs_interfaceid": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Converting VIF {"id": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "address": "fa:16:3e:71:83:eb", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2fcb0c2-e9", "ovs_interfaceid": "d2fcb0c2-e923-4f89-9911-c76e982dd729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:83:eb,bridge_name='br-int',has_traffic_filtering=True,id=d2fcb0c2-e923-4f89-9911-c76e982dd729,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fcb0c2-e9') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG os_vif [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:83:eb,bridge_name='br-int',has_traffic_filtering=True,id=d2fcb0c2-e923-4f89-9911-c76e982dd729,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fcb0c2-e9') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2fcb0c2-e9, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:55:36 user nova-compute[72409]: INFO os_vif [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:83:eb,bridge_name='br-int',has_traffic_filtering=True,id=d2fcb0c2-e923-4f89-9911-c76e982dd729,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2fcb0c2-e9')
Aug 09 22:55:36 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Deleting instance files /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25_del
Aug 09 22:55:36 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Deletion of /opt/stack/data/nova/instances/1f17088d-95df-44c9-aac2-24eced6fde25_del complete
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-6c7fb276-cc1e-402a-becc-4faf0129f509 req-0d4405cf-6bb5-427d-958a-a04a32a3cd5a service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Received event network-vif-unplugged-d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6c7fb276-cc1e-402a-becc-4faf0129f509 req-0d4405cf-6bb5-427d-958a-a04a32a3cd5a service nova] Acquiring lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6c7fb276-cc1e-402a-becc-4faf0129f509 req-0d4405cf-6bb5-427d-958a-a04a32a3cd5a service nova] Lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6c7fb276-cc1e-402a-becc-4faf0129f509 req-0d4405cf-6bb5-427d-958a-a04a32a3cd5a service nova] Lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-6c7fb276-cc1e-402a-becc-4faf0129f509 req-0d4405cf-6bb5-427d-958a-a04a32a3cd5a service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] No waiting events found dispatching network-vif-unplugged-d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-6c7fb276-cc1e-402a-becc-4faf0129f509 req-0d4405cf-6bb5-427d-958a-a04a32a3cd5a service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Received event network-vif-unplugged-d2fcb0c2-e923-4f89-9911-c76e982dd729 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:55:36 user nova-compute[72409]: INFO nova.compute.manager [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 09 22:55:36 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.compute.manager [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:55:36 user nova-compute[72409]: INFO nova.compute.manager [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] instance snapshotting
Aug 09 22:55:36 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Beginning live snapshot process
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-5da5d6d9-f556-4426-8a62-dff8f5b2caa5 req-61e19425-fcc4-4ef8-9815-ce2b3446e6f0 service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Received event network-vif-deleted-d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:36 user nova-compute[72409]: INFO nova.compute.manager [req-5da5d6d9-f556-4426-8a62-dff8f5b2caa5 req-61e19425-fcc4-4ef8-9815-ce2b3446e6f0 service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Neutron deleted interface d2fcb0c2-e923-4f89-9911-c76e982dd729; detaching it from the instance and deleting it from the info cache
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.network.neutron [req-5da5d6d9-f556-4426-8a62-dff8f5b2caa5 req-61e19425-fcc4-4ef8-9815-ce2b3446e6f0 service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:55:36 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Took 0.57 seconds to deallocate network for instance.
Aug 09 22:55:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-5da5d6d9-f556-4426-8a62-dff8f5b2caa5 req-61e19425-fcc4-4ef8-9815-ce2b3446e6f0 service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Detach interface failed, port_id=d2fcb0c2-e923-4f89-9911-c76e982dd729, reason: Instance 1f17088d-95df-44c9-aac2-24eced6fde25 could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json -f qcow2 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json -f qcow2 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json -f qcow2" returned: 0 in 0.167s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:37 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:55:37 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:55:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.528s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:37 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Deleted allocations for instance 1f17088d-95df-44c9-aac2-24eced6fde25
Aug 09 22:55:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.155s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp33h5y517/a5a7a6e18e08473ca8198d3bc28d5bb4.delta 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp33h5y517/a5a7a6e18e08473ca8198d3bc28d5bb4.delta 1073741824" returned: 0 in 0.053s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:37 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 22:55:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-abe82dbd-dd69-4d3d-8725-9e0d8302320d tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "1f17088d-95df-44c9-aac2-24eced6fde25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.349s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-289adde7-ad55-4c5f-a130-93f29092dcbd req-fb25d056-ba91-49d6-ac89-33cd2a4aa0da service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Received event network-vif-plugged-d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-289adde7-ad55-4c5f-a130-93f29092dcbd req-fb25d056-ba91-49d6-ac89-33cd2a4aa0da service nova] Acquiring lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-289adde7-ad55-4c5f-a130-93f29092dcbd req-fb25d056-ba91-49d6-ac89-33cd2a4aa0da service nova] Lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-289adde7-ad55-4c5f-a130-93f29092dcbd req-fb25d056-ba91-49d6-ac89-33cd2a4aa0da service nova] Lock "1f17088d-95df-44c9-aac2-24eced6fde25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-289adde7-ad55-4c5f-a130-93f29092dcbd req-fb25d056-ba91-49d6-ac89-33cd2a4aa0da service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] No waiting events found dispatching network-vif-plugged-d2fcb0c2-e923-4f89-9911-c76e982dd729 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:38 user nova-compute[72409]: WARNING nova.compute.manager [req-289adde7-ad55-4c5f-a130-93f29092dcbd req-fb25d056-ba91-49d6-ac89-33cd2a4aa0da service nova] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Received unexpected event network-vif-plugged-d2fcb0c2-e923-4f89-9911-c76e982dd729 for instance with vm_state deleted and task_state None.
Aug 09 22:55:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:55:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] COPY block job progress, current cursor: 21889024 final cursor: 75497472 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:55:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 22:55:39 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 22:55:39 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 22:55:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp33h5y517/a5a7a6e18e08473ca8198d3bc28d5bb4.delta /opt/stack/data/nova/instances/snapshots/tmp33h5y517/a5a7a6e18e08473ca8198d3bc28d5bb4 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp33h5y517/a5a7a6e18e08473ca8198d3bc28d5bb4.delta /opt/stack/data/nova/instances/snapshots/tmp33h5y517/a5a7a6e18e08473ca8198d3bc28d5bb4" returned: 0 in 0.548s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:40 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Snapshot extracted, beginning image upload
Aug 09 22:55:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:55:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 22:55:43 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Snapshot image upload complete
Aug 09 22:55:43 user nova-compute[72409]: INFO nova.compute.manager [None req-210059ac-8497-46db-abd8-43ddbcc62507 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Took 6.93 seconds to snapshot the instance on the hypervisor.
Aug 09 22:55:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:44 user nova-compute[72409]: INFO nova.compute.manager [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Detaching volume afc3b053-5a66-420c-8b7a-e33094cb2125
Aug 09 22:55:44 user nova-compute[72409]: INFO nova.virt.block_device [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Attempting to driver detach volume afc3b053-5a66-420c-8b7a-e33094cb2125 from mountpoint /dev/vdc
Aug 09 22:55:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Attempting to detach device vdc from instance 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 22:55:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 22:55:44 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:55:44 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 22:55:44 user nova-compute[72409]:   <target dev="vdc" bus="virtio"/>
Aug 09 22:55:44 user nova-compute[72409]:   <serial>afc3b053-5a66-420c-8b7a-e33094cb2125</serial>
Aug 09 22:55:44 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 22:55:44 user nova-compute[72409]: </disk>
Aug 09 22:55:44 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:55:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Successfully detached device vdc from instance 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 from the persistent domain config.
Aug 09 22:55:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 22:55:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 22:55:44 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:55:44 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 22:55:44 user nova-compute[72409]:   <target dev="vdc" bus="virtio"/>
Aug 09 22:55:44 user nova-compute[72409]:   <serial>afc3b053-5a66-420c-8b7a-e33094cb2125</serial>
Aug 09 22:55:44 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 22:55:44 user nova-compute[72409]: </disk>
Aug 09 22:55:44 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691621745.379529, 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 22:55:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Successfully detached device vdc from instance 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 from the live domain config.
Aug 09 22:55:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTXpGlMK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:55:45 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecb8fe6-668f-4c90-a61c-dd7d7edb401c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd0997e-64cf-4771-b7fa-f4c4a10720e0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:55:45 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:55:45 user nova-compute[72409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:55:45 user nova-compute[72409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)
Aug 09 22:55:45 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 (non-flash)
Aug 09 22:55:45 user nova-compute[72409]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:55:45 user nova-compute[72409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:55:45 user nova-compute[72409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)
Aug 09 22:55:45 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e9c131240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee8c908-4c39-4f57-aae6-7440b83ecf4e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d379bf79-669a-407c-9a03-bc112507ca8d]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84cc209-a8c9-49b5-a523-fb9e3007b320]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.147s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed18f979-d37a-4844-be07-1c9a9f8eb3fa]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1021316-16cc-469d-88b6-caaaa1856e62]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcff42bb-c6a2-4b8e-9b49-f0d4be80dd34]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125, portal: 172.16.0.220,3260]
Aug 09 22:55:45 user nova-compute[72409]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125, portal: 172.16.0.220,3260] successful.
Aug 09 22:55:45 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afc3b053-5a66-420c-8b7a-e33094cb2125 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3212b800-6316-48af-b5b3-fe792f098b57]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] <== disconnect_volume: return (391ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 22:55:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] There are 0 instances to clean {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 22:55:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:46 user nova-compute[72409]: DEBUG nova.objects.instance [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'flavor' on Instance uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:55:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f78d13d9-890d-4174-b6a4-d4a2feaa60bc tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.800s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:47 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:55:47 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:55:47 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:55:48 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:55:48 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:55:49 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:55:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:55:49 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621736.097506, 1f17088d-95df-44c9-aac2-24eced6fde25 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:55:51 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] VM Stopped (Lifecycle Event)
Aug 09 22:55:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-88f86895-8e1c-44f4-b49b-38d193fe7aa1 None None] [instance: 1f17088d-95df-44c9-aac2-24eced6fde25] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-6f4df30c-dafc-4878-88e0-3186749578ec req-6a4d44cb-2929-4ba2-859f-7584a5c9462e service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-changed-c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-6f4df30c-dafc-4878-88e0-3186749578ec req-6a4d44cb-2929-4ba2-859f-7584a5c9462e service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing instance network info cache due to event network-changed-c14ceb07-7e71-4723-88ff-482f29035aa0. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6f4df30c-dafc-4878-88e0-3186749578ec req-6a4d44cb-2929-4ba2-859f-7584a5c9462e service nova] Acquiring lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6f4df30c-dafc-4878-88e0-3186749578ec req-6a4d44cb-2929-4ba2-859f-7584a5c9462e service nova] Acquired lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG nova.network.neutron [req-6f4df30c-dafc-4878-88e0-3186749578ec req-6a4d44cb-2929-4ba2-859f-7584a5c9462e service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Refreshing network info cache for port c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:51 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG nova.network.neutron [req-6f4df30c-dafc-4878-88e0-3186749578ec req-6a4d44cb-2929-4ba2-859f-7584a5c9462e service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updated VIF entry in instance network info cache for port c14ceb07-7e71-4723-88ff-482f29035aa0. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG nova.network.neutron [req-6f4df30c-dafc-4878-88e0-3186749578ec req-6a4d44cb-2929-4ba2-859f-7584a5c9462e service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [{"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "49e29e6b-a887-425f-9eca-94a25bdb3301", "address": "fa:16:3e:e7:a2:b1", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e29e6b-a8", "ovs_interfaceid": "49e29e6b-a887-425f-9eca-94a25bdb3301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "117c1972-75f2-4cd5-a229-53cd2361c506", "address": "fa:16:3e:84:1e:d3", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap117c1972-75", "ovs_interfaceid": "117c1972-75f2-4cd5-a229-53cd2361c506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6f4df30c-dafc-4878-88e0-3186749578ec req-6a4d44cb-2929-4ba2-859f-7584a5c9462e service nova] Releasing lock "refresh_cache-f7f4be37-e516-4cd5-82bd-fa554f5e4c18" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:54 user nova-compute[72409]: INFO nova.compute.manager [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Terminating instance
Aug 09 22:55:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-4b9eba55-dbff-49ab-8e39-fc0703f90d1a req-eb1217af-2268-4de5-b6ee-e2d4055fbae1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4b9eba55-dbff-49ab-8e39-fc0703f90d1a req-eb1217af-2268-4de5-b6ee-e2d4055fbae1 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4b9eba55-dbff-49ab-8e39-fc0703f90d1a req-eb1217af-2268-4de5-b6ee-e2d4055fbae1 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4b9eba55-dbff-49ab-8e39-fc0703f90d1a req-eb1217af-2268-4de5-b6ee-e2d4055fbae1 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-4b9eba55-dbff-49ab-8e39-fc0703f90d1a req-eb1217af-2268-4de5-b6ee-e2d4055fbae1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-unplugged-c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-4b9eba55-dbff-49ab-8e39-fc0703f90d1a req-eb1217af-2268-4de5-b6ee-e2d4055fbae1 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-c14ceb07-7e71-4723-88ff-482f29035aa0 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-2319c99c-8d87-4029-9ca9-bd0e0e13935e req-ee9149ca-1957-4190-99ba-125d793583fd service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-5da1a50d-d954-4558-ab6a-334eb3986c37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2319c99c-8d87-4029-9ca9-bd0e0e13935e req-ee9149ca-1957-4190-99ba-125d793583fd service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2319c99c-8d87-4029-9ca9-bd0e0e13935e req-ee9149ca-1957-4190-99ba-125d793583fd service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2319c99c-8d87-4029-9ca9-bd0e0e13935e req-ee9149ca-1957-4190-99ba-125d793583fd service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-2319c99c-8d87-4029-9ca9-bd0e0e13935e req-ee9149ca-1957-4190-99ba-125d793583fd service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-unplugged-5da1a50d-d954-4558-ab6a-334eb3986c37 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-2319c99c-8d87-4029-9ca9-bd0e0e13935e req-ee9149ca-1957-4190-99ba-125d793583fd service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-5da1a50d-d954-4558-ab6a-334eb3986c37 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-8b99e81a-c2a0-4d35-b74a-880d8407853a req-e33ca4d9-f814-47c1-91e9-3e39918549b8 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8b99e81a-c2a0-4d35-b74a-880d8407853a req-e33ca4d9-f814-47c1-91e9-3e39918549b8 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8b99e81a-c2a0-4d35-b74a-880d8407853a req-e33ca4d9-f814-47c1-91e9-3e39918549b8 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8b99e81a-c2a0-4d35-b74a-880d8407853a req-e33ca4d9-f814-47c1-91e9-3e39918549b8 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-8b99e81a-c2a0-4d35-b74a-880d8407853a req-e33ca4d9-f814-47c1-91e9-3e39918549b8 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-unplugged-d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-8b99e81a-c2a0-4d35-b74a-880d8407853a req-e33ca4d9-f814-47c1-91e9-3e39918549b8 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-d0512c07-7c8a-4e50-8a26-218871739981 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:55:56 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Instance destroyed successfully.
Aug 09 22:55:56 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:55:56 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7217MB free_disk=25.547454833984375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.objects.instance [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lazy-loading 'resources' on Instance uuid f7f4be37-e516-4cd5-82bd-fa554f5e4c18 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:77:7d,bridge_name='br-int',has_traffic_filtering=True,id=c14ceb07-7e71-4723-88ff-482f29035aa0,network=Network(ed8d100d-7560-497e-a67c-dfa6c94bc7d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ceb07-7e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:77:7d,bridge_name='br-int',has_traffic_filtering=True,id=c14ceb07-7e71-4723-88ff-482f29035aa0,network=Network(ed8d100d-7560-497e-a67c-dfa6c94bc7d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ceb07-7e') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc14ceb07-7e, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: INFO os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:77:7d,bridge_name='br-int',has_traffic_filtering=True,id=c14ceb07-7e71-4723-88ff-482f29035aa0,network=Network(ed8d100d-7560-497e-a67c-dfa6c94bc7d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc14ceb07-7e')
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:bd,bridge_name='br-int',has_traffic_filtering=True,id=5da1a50d-d954-4558-ab6a-334eb3986c37,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5da1a50d-d9') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:bd,bridge_name='br-int',has_traffic_filtering=True,id=5da1a50d-d954-4558-ab6a-334eb3986c37,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5da1a50d-d9') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5da1a50d-d9, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:56 user nova-compute[72409]: WARNING nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-c14ceb07-7e71-4723-88ff-482f29035aa0 for instance with vm_state active and task_state deleting.
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-c7073d80-257f-4127-823e-13f02e3997e3 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-unplugged-c7073d80-257f-4127-823e-13f02e3997e3 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-c7073d80-257f-4127-823e-13f02e3997e3 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-c7073d80-257f-4127-823e-13f02e3997e3 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-c7073d80-257f-4127-823e-13f02e3997e3 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:56 user nova-compute[72409]: WARNING nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-c7073d80-257f-4127-823e-13f02e3997e3 for instance with vm_state active and task_state deleting.
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-unplugged-117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-117c1972-75f2-4cd5-a229-53cd2361c506 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:56 user nova-compute[72409]: WARNING nova.compute.manager [req-c06e50cb-7f18-4105-b28b-e58657813132 req-fd13c46d-dd20-44b6-bb84-25361cd04d11 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-117c1972-75f2-4cd5-a229-53cd2361c506 for instance with vm_state active and task_state deleting.
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: INFO os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d0:bd,bridge_name='br-int',has_traffic_filtering=True,id=5da1a50d-d954-4558-ab6a-334eb3986c37,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5da1a50d-d9')
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:7d,bridge_name='br-int',has_traffic_filtering=True,id=c7073d80-257f-4127-823e-13f02e3997e3,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc7073d80-25') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:7d,bridge_name='br-int',has_traffic_filtering=True,id=c7073d80-257f-4127-823e-13f02e3997e3,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc7073d80-25') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7073d80-25, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-5da1a50d-d954-4558-ab6a-334eb3986c37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-5da1a50d-d954-4558-ab6a-334eb3986c37 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:56 user nova-compute[72409]: WARNING nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-5da1a50d-d954-4558-ab6a-334eb3986c37 for instance with vm_state active and task_state deleting.
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-unplugged-596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-596e3df6-8719-490f-8f60-73578c9cf511 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:56 user nova-compute[72409]: WARNING nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-596e3df6-8719-490f-8f60-73578c9cf511 for instance with vm_state active and task_state deleting.
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-unplugged-49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-unplugged-49e29e6b-a887-425f-9eca-94a25bdb3301 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:56 user nova-compute[72409]: WARNING nova.compute.manager [req-0399d1db-9355-4c1d-b2c3-005d27a3ed5d req-a3bf22a4-5229-45ce-8d8d-74d0ef8bd719 service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-49e29e6b-a887-425f-9eca-94a25bdb3301 for instance with vm_state active and task_state deleting.
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: INFO os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:7d,bridge_name='br-int',has_traffic_filtering=True,id=c7073d80-257f-4127-823e-13f02e3997e3,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc7073d80-25')
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:6c:43,bridge_name='br-int',has_traffic_filtering=True,id=d0512c07-7c8a-4e50-8a26-218871739981,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0512c07-7c') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:6c:43,bridge_name='br-int',has_traffic_filtering=True,id=d0512c07-7c8a-4e50-8a26-218871739981,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0512c07-7c') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0512c07-7c, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5af7f4c7-5937-4b69-831e-941d7de4417d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5b7906a3-e02b-49a3-9a56-fc34a8730238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance f7f4be37-e516-4cd5-82bd-fa554f5e4c18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c17c9b77-8e04-432c-9634-c4bee2eb8889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 122c668a-56c6-46b0-9e1f-2f39bdea7418 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c513e397-28f7-4d93-8487-257becbef9d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: INFO os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:6c:43,bridge_name='br-int',has_traffic_filtering=True,id=d0512c07-7c8a-4e50-8a26-218871739981,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0512c07-7c')
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:00:46,bridge_name='br-int',has_traffic_filtering=True,id=596e3df6-8719-490f-8f60-73578c9cf511,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596e3df6-87') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:00:46,bridge_name='br-int',has_traffic_filtering=True,id=596e3df6-8719-490f-8f60-73578c9cf511,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596e3df6-87') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap596e3df6-87, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing inventories for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: INFO os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:00:46,bridge_name='br-int',has_traffic_filtering=True,id=596e3df6-8719-490f-8f60-73578c9cf511,network=Network(00b86307-8a45-4d49-b97e-cdea87000fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap596e3df6-87')
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49e29e6b-a887-425f-9eca-94a25bdb3301", "address": "fa:16:3e:e7:a2:b1", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e29e6b-a8", "ovs_interfaceid": "49e29e6b-a887-425f-9eca-94a25bdb3301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "49e29e6b-a887-425f-9eca-94a25bdb3301", "address": "fa:16:3e:e7:a2:b1", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e29e6b-a8", "ovs_interfaceid": "49e29e6b-a887-425f-9eca-94a25bdb3301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a2:b1,bridge_name='br-int',has_traffic_filtering=True,id=49e29e6b-a887-425f-9eca-94a25bdb3301,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e29e6b-a8') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a2:b1,bridge_name='br-int',has_traffic_filtering=True,id=49e29e6b-a887-425f-9eca-94a25bdb3301,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e29e6b-a8') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49e29e6b-a8, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: INFO os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a2:b1,bridge_name='br-int',has_traffic_filtering=True,id=49e29e6b-a887-425f-9eca-94a25bdb3301,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e29e6b-a8')
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T22:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-848445428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-848445428',id=15,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrkpwWi/cSYQzrdmFb0OKYXz5XdNwdom7kkLrdXTHgKvipZhD71hHt/aeomHS8Pu2uTEA6TBz2/NsFkp2xIwpEPBp1N0fuQoJqJljlqT3wC0P30Ld3zCcOeflY9mSaxGw==',key_name='tempest-keypair-2143167797',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebc4cb0f78e64f8ea5b40bb6d20cc107',ramdisk_id='',reservation_id='r-jt0qcolv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-331933323',owner_user_name='tempest-TaggedBootDevicesTest_v242-331933323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d18abb14d08141a487b3bd0f51333be8',uuid=f7f4be37-e516-4cd5-82bd-fa554f5e4c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "117c1972-75f2-4cd5-a229-53cd2361c506", "address": "fa:16:3e:84:1e:d3", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap117c1972-75", "ovs_interfaceid": "117c1972-75f2-4cd5-a229-53cd2361c506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converting VIF {"id": "117c1972-75f2-4cd5-a229-53cd2361c506", "address": "fa:16:3e:84:1e:d3", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap117c1972-75", "ovs_interfaceid": "117c1972-75f2-4cd5-a229-53cd2361c506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:1e:d3,bridge_name='br-int',has_traffic_filtering=True,id=117c1972-75f2-4cd5-a229-53cd2361c506,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117c1972-75') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:1e:d3,bridge_name='br-int',has_traffic_filtering=True,id=117c1972-75f2-4cd5-a229-53cd2361c506,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117c1972-75') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating ProviderTree inventory for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap117c1972-75, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:55:56 user nova-compute[72409]: INFO os_vif [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:1e:d3,bridge_name='br-int',has_traffic_filtering=True,id=117c1972-75f2-4cd5-a229-53cd2361c506,network=Network(e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117c1972-75')
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMiDTeyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:55:56 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:55:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing aggregate associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, aggregates: None {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dc4b0d-dbd5-4ab6-81ef-f419fddb3b83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing trait associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc94a7a0-6a97-417f-aae7-2a39ce16f133]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:55:56 user nova-compute[72409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:55:56 user nova-compute[72409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)
Aug 09 22:55:56 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a (non-flash)
Aug 09 22:55:57 user nova-compute[72409]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:55:57 user nova-compute[72409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)
Aug 09 22:55:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84460820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4507b88-1406-4ee4-900c-89414c95f1e3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3673627a-7ab2-43ea-bc1e-cb6c4e04eec6]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b32bae-4567-4f9a-a736-cc0de757977e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dab35dc-838f-44d2-afce-b11244f2730f]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-e2a81b8c-c258-4381-bd1c-2cba983d42a1 req-032271c6-074e-435d-800b-f6ec4cea498a service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-plugged-d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e2a81b8c-c258-4381-bd1c-2cba983d42a1 req-032271c6-074e-435d-800b-f6ec4cea498a service nova] Acquiring lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e2a81b8c-c258-4381-bd1c-2cba983d42a1 req-032271c6-074e-435d-800b-f6ec4cea498a service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e2a81b8c-c258-4381-bd1c-2cba983d42a1 req-032271c6-074e-435d-800b-f6ec4cea498a service nova] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-e2a81b8c-c258-4381-bd1c-2cba983d42a1 req-032271c6-074e-435d-800b-f6ec4cea498a service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] No waiting events found dispatching network-vif-plugged-d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:55:57 user nova-compute[72409]: WARNING nova.compute.manager [req-e2a81b8c-c258-4381-bd1c-2cba983d42a1 req-032271c6-074e-435d-800b-f6ec4cea498a service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received unexpected event network-vif-plugged-d0512c07-7c8a-4e50-8a26-218871739981 for instance with vm_state active and task_state deleting.
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.065s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de8f1fb-d657-4396-82c1-d30522a9e204]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebb3a95-3c6d-47a5-8710-ed56a9728094]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a, portal: 172.16.0.220,3260]
Aug 09 22:55:57 user nova-compute[72409]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a, portal: 172.16.0.220,3260] successful.
Aug 09 22:55:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7d8d350-15a0-4271-9b13-f063e5b7e68a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[69122bc5-386b-4c6a-b01a-9ebe4fd044e8]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] <== disconnect_volume: return (400ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aoeJOZVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:55:57 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b915c6-df8a-4907-8027-a12c09e1bd64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.887s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab3a291-844b-4104-90ab-d8a50fb5a951]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:55:57 user nova-compute[72409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)
Aug 09 22:55:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 (non-flash)
Aug 09 22:55:57 user nova-compute[72409]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)
Aug 09 22:55:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e8453d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56'): ({'sde'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Removing single pathed devices sde {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bdf0ba-2cbb-492e-87ec-2512f925f8f5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[88550527-187b-4816-bf2a-ffa2f941939d]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Flushing IO for device /dev/sde {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b049699-430a-4471-ac90-ce8e16c6dd86]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[87723e23-d109-4dea-aeb0-592a7fa941b2]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2281e76c-df8f-45ae-813e-e7bab8c80848]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e129e50a-ecae-4b0f-b583-e1df482e3e65]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56, portal: 172.16.0.220,3260]
Aug 09 22:55:57 user nova-compute[72409]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56, portal: 172.16.0.220,3260] successful.
Aug 09 22:55:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d4523c-9193-4225-a542-03bab1455a56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[91169a28-7868-4673-9fe2-c7d4ca52765b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] <== disconnect_volume: return (335ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZyvrkfN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:55:57 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[72665c2b-3c31-493c-b0b3-a2fe4da6ed05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df62bdd-944b-4554-9e46-1185817e5a24]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)
Aug 09 22:55:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 (non-flash)
Aug 09 22:55:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e845badd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455'): ({'sdd'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Removing single pathed devices sdd {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1db777-a566-402c-b814-aaab4ccaaaea]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a742eab-0ef0-4b98-be8b-c735a357128d]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Flushing IO for device /dev/sdd {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9504dc-e494-411b-8c50-529b1888a0d5]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[102ad7ad-177c-4371-aaa6-1d135caa0986]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18cf24e-1b4f-4d8c-9d88-6c34673cb9ab]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60b23d5-f957-4f7c-a620-0c3f691474ab]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455, portal: 172.16.0.220,3260]
Aug 09 22:55:57 user nova-compute[72409]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455, portal: 172.16.0.220,3260] successful.
Aug 09 22:55:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a47e67ae-231c-48d6-9528-d2f84c681455 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e2d9ae-d9bc-4d49-9a75-b2c7dfaf922e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] <== disconnect_volume: return (258ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:55:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:55:57 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Deleting instance files /opt/stack/data/nova/instances/f7f4be37-e516-4cd5-82bd-fa554f5e4c18_del
Aug 09 22:55:57 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Deletion of /opt/stack/data/nova/instances/f7f4be37-e516-4cd5-82bd-fa554f5e4c18_del complete
Aug 09 22:55:58 user nova-compute[72409]: INFO nova.compute.manager [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Took 3.78 seconds to destroy the instance on the hypervisor.
Aug 09 22:55:58 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:55:58 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:55:58 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:55:58 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:55:58 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:55:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:55:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:55:58 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 22:55:59 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updating instance_info_cache with network_info: [{"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:55:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:55:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 22:55:59 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:56:00 user nova-compute[72409]: DEBUG nova.compute.manager [req-4f9d85ff-b12e-4224-927e-14c2a6b1f362 req-7257f40c-adc1-488c-8a6a-3ba5f26e664b service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-deleted-117c1972-75f2-4cd5-a229-53cd2361c506 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:00 user nova-compute[72409]: INFO nova.compute.manager [req-4f9d85ff-b12e-4224-927e-14c2a6b1f362 req-7257f40c-adc1-488c-8a6a-3ba5f26e664b service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Neutron deleted interface 117c1972-75f2-4cd5-a229-53cd2361c506; detaching it from the instance and deleting it from the info cache
Aug 09 22:56:00 user nova-compute[72409]: DEBUG nova.network.neutron [req-4f9d85ff-b12e-4224-927e-14c2a6b1f362 req-7257f40c-adc1-488c-8a6a-3ba5f26e664b service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [{"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "49e29e6b-a887-425f-9eca-94a25bdb3301", "address": "fa:16:3e:e7:a2:b1", "network": {"id": "e9ff5d0f-aaac-4be4-bc87-a2e54bf9ac62", "bridge": "br-int", "label": "tempest-device-tagging-net2-1068497053", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e29e6b-a8", "ovs_interfaceid": "49e29e6b-a887-425f-9eca-94a25bdb3301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:00 user nova-compute[72409]: DEBUG nova.compute.manager [req-4f9d85ff-b12e-4224-927e-14c2a6b1f362 req-7257f40c-adc1-488c-8a6a-3ba5f26e664b service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Detach interface failed, port_id=117c1972-75f2-4cd5-a229-53cd2361c506, reason: Instance f7f4be37-e516-4cd5-82bd-fa554f5e4c18 could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 22:56:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-a8727378-69d8-4502-a743-e4ab746ed57d req-ceceea11-2685-470f-ae94-4f24343d7aab service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-deleted-49e29e6b-a887-425f-9eca-94a25bdb3301 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:02 user nova-compute[72409]: INFO nova.compute.manager [req-a8727378-69d8-4502-a743-e4ab746ed57d req-ceceea11-2685-470f-ae94-4f24343d7aab service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Neutron deleted interface 49e29e6b-a887-425f-9eca-94a25bdb3301; detaching it from the instance and deleting it from the info cache
Aug 09 22:56:02 user nova-compute[72409]: DEBUG nova.network.neutron [req-a8727378-69d8-4502-a743-e4ab746ed57d req-ceceea11-2685-470f-ae94-4f24343d7aab service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [{"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0512c07-7c8a-4e50-8a26-218871739981", "address": "fa:16:3e:c2:6c:43", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0512c07-7c", "ovs_interfaceid": "d0512c07-7c8a-4e50-8a26-218871739981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-a8727378-69d8-4502-a743-e4ab746ed57d req-ceceea11-2685-470f-ae94-4f24343d7aab service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Detach interface failed, port_id=49e29e6b-a887-425f-9eca-94a25bdb3301, reason: Instance f7f4be37-e516-4cd5-82bd-fa554f5e4c18 could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 22:56:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-a8727378-69d8-4502-a743-e4ab746ed57d req-ceceea11-2685-470f-ae94-4f24343d7aab service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-deleted-d0512c07-7c8a-4e50-8a26-218871739981 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:02 user nova-compute[72409]: INFO nova.compute.manager [req-a8727378-69d8-4502-a743-e4ab746ed57d req-ceceea11-2685-470f-ae94-4f24343d7aab service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Neutron deleted interface d0512c07-7c8a-4e50-8a26-218871739981; detaching it from the instance and deleting it from the info cache
Aug 09 22:56:02 user nova-compute[72409]: DEBUG nova.network.neutron [req-a8727378-69d8-4502-a743-e4ab746ed57d req-ceceea11-2685-470f-ae94-4f24343d7aab service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [{"id": "c14ceb07-7e71-4723-88ff-482f29035aa0", "address": "fa:16:3e:14:77:7d", "network": {"id": "ed8d100d-7560-497e-a67c-dfa6c94bc7d1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1520405972-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc14ceb07-7e", "ovs_interfaceid": "c14ceb07-7e71-4723-88ff-482f29035aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-a8727378-69d8-4502-a743-e4ab746ed57d req-ceceea11-2685-470f-ae94-4f24343d7aab service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Detach interface failed, port_id=d0512c07-7c8a-4e50-8a26-218871739981, reason: Instance f7f4be37-e516-4cd5-82bd-fa554f5e4c18 could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 22:56:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-a8727378-69d8-4502-a743-e4ab746ed57d req-ceceea11-2685-470f-ae94-4f24343d7aab service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-deleted-c14ceb07-7e71-4723-88ff-482f29035aa0 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:02 user nova-compute[72409]: INFO nova.compute.manager [req-a8727378-69d8-4502-a743-e4ab746ed57d req-ceceea11-2685-470f-ae94-4f24343d7aab service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Neutron deleted interface c14ceb07-7e71-4723-88ff-482f29035aa0; detaching it from the instance and deleting it from the info cache
Aug 09 22:56:02 user nova-compute[72409]: DEBUG nova.network.neutron [req-a8727378-69d8-4502-a743-e4ab746ed57d req-ceceea11-2685-470f-ae94-4f24343d7aab service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [{"id": "5da1a50d-d954-4558-ab6a-334eb3986c37", "address": "fa:16:3e:bc:d0:bd", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5da1a50d-d9", "ovs_interfaceid": "5da1a50d-d954-4558-ab6a-334eb3986c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7073d80-257f-4127-823e-13f02e3997e3", "address": "fa:16:3e:44:ca:7d", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7073d80-25", "ovs_interfaceid": "c7073d80-257f-4127-823e-13f02e3997e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "596e3df6-8719-490f-8f60-73578c9cf511", "address": "fa:16:3e:3c:00:46", "network": {"id": "00b86307-8a45-4d49-b97e-cdea87000fc6", "bridge": "br-int", "label": "tempest-device-tagging-net1-753722454", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ebc4cb0f78e64f8ea5b40bb6d20cc107", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap596e3df6-87", "ovs_interfaceid": "596e3df6-8719-490f-8f60-73578c9cf511", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-a8727378-69d8-4502-a743-e4ab746ed57d req-ceceea11-2685-470f-ae94-4f24343d7aab service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Detach interface failed, port_id=c14ceb07-7e71-4723-88ff-482f29035aa0, reason: Instance f7f4be37-e516-4cd5-82bd-fa554f5e4c18 could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 22:56:02 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:02 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Took 4.47 seconds to deallocate network for instance.
Aug 09 22:56:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-4f919b20-4c80-483e-ba73-35e6e3090e2a req-caf4a664-98fa-43e7-b2c4-c31cd3fb44c8 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-changed-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-4f919b20-4c80-483e-ba73-35e6e3090e2a req-caf4a664-98fa-43e7-b2c4-c31cd3fb44c8 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Refreshing instance network info cache due to event network-changed-410a93bc-9f2d-473e-acfb-bf171c4bcf4a. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:56:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4f919b20-4c80-483e-ba73-35e6e3090e2a req-caf4a664-98fa-43e7-b2c4-c31cd3fb44c8 service nova] Acquiring lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:56:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4f919b20-4c80-483e-ba73-35e6e3090e2a req-caf4a664-98fa-43e7-b2c4-c31cd3fb44c8 service nova] Acquired lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:56:03 user nova-compute[72409]: DEBUG nova.network.neutron [req-4f919b20-4c80-483e-ba73-35e6e3090e2a req-caf4a664-98fa-43e7-b2c4-c31cd3fb44c8 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Refreshing network info cache for port 410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:56:03 user nova-compute[72409]: DEBUG nova.network.neutron [req-4f919b20-4c80-483e-ba73-35e6e3090e2a req-caf4a664-98fa-43e7-b2c4-c31cd3fb44c8 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updated VIF entry in instance network info cache for port 410a93bc-9f2d-473e-acfb-bf171c4bcf4a. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:56:03 user nova-compute[72409]: DEBUG nova.network.neutron [req-4f919b20-4c80-483e-ba73-35e6e3090e2a req-caf4a664-98fa-43e7-b2c4-c31cd3fb44c8 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updating instance_info_cache with network_info: [{"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4f919b20-4c80-483e-ba73-35e6e3090e2a req-caf4a664-98fa-43e7-b2c4-c31cd3fb44c8 service nova] Releasing lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:56:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-66f1b593-e6d6-400f-82ca-c2402dd9efc2 req-e6aec5f6-a1b1-4614-b77f-cf4377a1b00d service nova] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Received event network-vif-deleted-596e3df6-8719-490f-8f60-73578c9cf511 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:04 user nova-compute[72409]: INFO nova.compute.manager [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Took 2.43 seconds to detach 3 volumes for instance.
Aug 09 22:56:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:05 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:56:05 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:56:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:05 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Deleted allocations for instance f7f4be37-e516-4cd5-82bd-fa554f5e4c18
Aug 09 22:56:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-65f228b9-c1de-4be5-9600-66df8f22d2ab tempest-TaggedBootDevicesTest_v242-331933323 tempest-TaggedBootDevicesTest_v242-331933323-project-member] Lock "f7f4be37-e516-4cd5-82bd-fa554f5e4c18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.207s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:11 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621756.2019758, f7f4be37-e516-4cd5-82bd-fa554f5e4c18 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:56:11 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] VM Stopped (Lifecycle Event)
Aug 09 22:56:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-72c88c32-c48d-4718-a961-4b5b5b2e3587 None None] [instance: f7f4be37-e516-4cd5-82bd-fa554f5e4c18] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:56:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 935c4677-a511-4b0e-aef3-57bc036220ab {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 5af7f4c7-5937-4b69-831e-941d7de4417d {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 5b7906a3-e02b-49a3-9a56-fc34a8730238 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid c17c9b77-8e04-432c-9634-c4bee2eb8889 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 122c668a-56c6-46b0-9e1f-2f39bdea7418 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "935c4677-a511-4b0e-aef3-57bc036220ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "935c4677-a511-4b0e-aef3-57bc036220ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "5af7f4c7-5937-4b69-831e-941d7de4417d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "5b7906a3-e02b-49a3-9a56-fc34a8730238" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "3f216945-199d-4047-8bc8-407d5842c536" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "c17c9b77-8e04-432c-9634-c4bee2eb8889" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "122c668a-56c6-46b0-9e1f-2f39bdea7418" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "c513e397-28f7-4d93-8487-257becbef9d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "935c4677-a511-4b0e-aef3-57bc036220ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.361s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.410s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.425s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.435s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "3f216945-199d-4047-8bc8-407d5842c536" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.435s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "c513e397-28f7-4d93-8487-257becbef9d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.443s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.473s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.484s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "5af7f4c7-5937-4b69-831e-941d7de4417d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:31 user nova-compute[72409]: INFO nova.compute.manager [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Terminating instance
Aug 09 22:56:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:56:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-659b5150-c7d8-4535-b7a5-810a66d2280e req-ce2c1e0f-0416-477d-b76f-288770bd7b67 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Received event network-vif-unplugged-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-659b5150-c7d8-4535-b7a5-810a66d2280e req-ce2c1e0f-0416-477d-b76f-288770bd7b67 service nova] Acquiring lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-659b5150-c7d8-4535-b7a5-810a66d2280e req-ce2c1e0f-0416-477d-b76f-288770bd7b67 service nova] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-659b5150-c7d8-4535-b7a5-810a66d2280e req-ce2c1e0f-0416-477d-b76f-288770bd7b67 service nova] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-659b5150-c7d8-4535-b7a5-810a66d2280e req-ce2c1e0f-0416-477d-b76f-288770bd7b67 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] No waiting events found dispatching network-vif-unplugged-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-659b5150-c7d8-4535-b7a5-810a66d2280e req-ce2c1e0f-0416-477d-b76f-288770bd7b67 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Received event network-vif-unplugged-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:56:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Instance destroyed successfully.
Aug 09 22:56:32 user nova-compute[72409]: DEBUG nova.objects.instance [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lazy-loading 'resources' on Instance uuid 5af7f4c7-5937-4b69-831e-941d7de4417d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-212733071',display_name='tempest-VolumesAdminNegativeTest-server-212733071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-212733071',id=4,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6AxoPSiqQoQ50r9M9jKCRoK7PAuLg4UtxRFf5fYuX1lO+yKsORcWJT1yLe+H8BTjaP+9JlKTK4xcqLp3MvzNFfIqlYJl2QXGkUxpsiigugiQeepjLlKsbFYWEwga1P+w==',key_name='tempest-keypair-1388316913',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3700dd59a4548ca8e2ec8dd02ecc6a7',ramdisk_id='',reservation_id='r-n2euh8p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-994899237',owner_user_name='tempest-VolumesAdminNegativeTest-994899237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5567e41fceda4b8abf8d8d56a8bab9b2',uuid=5af7f4c7-5937-4b69-831e-941d7de4417d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "address": "fa:16:3e:92:55:4d", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eff036f-2f", "ovs_interfaceid": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Converting VIF {"id": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "address": "fa:16:3e:92:55:4d", "network": {"id": "317655ab-7a9e-45e4-ad16-9171ade9b365", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1211757127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3700dd59a4548ca8e2ec8dd02ecc6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eff036f-2f", "ovs_interfaceid": "8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:55:4d,bridge_name='br-int',has_traffic_filtering=True,id=8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eff036f-2f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG os_vif [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:55:4d,bridge_name='br-int',has_traffic_filtering=True,id=8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eff036f-2f') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eff036f-2f, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:56:32 user nova-compute[72409]: INFO os_vif [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:55:4d,bridge_name='br-int',has_traffic_filtering=True,id=8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d,network=Network(317655ab-7a9e-45e4-ad16-9171ade9b365),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eff036f-2f')
Aug 09 22:56:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Deleting instance files /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d_del
Aug 09 22:56:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Deletion of /opt/stack/data/nova/instances/5af7f4c7-5937-4b69-831e-941d7de4417d_del complete
Aug 09 22:56:32 user nova-compute[72409]: INFO nova.compute.manager [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 09 22:56:32 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:56:32 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:56:34 user nova-compute[72409]: DEBUG nova.compute.manager [req-2ef7dadf-3ef7-48b3-8384-e2d89f4b6494 req-883e20e5-7f17-4d45-9c05-77bf193c01c4 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Received event network-vif-plugged-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2ef7dadf-3ef7-48b3-8384-e2d89f4b6494 req-883e20e5-7f17-4d45-9c05-77bf193c01c4 service nova] Acquiring lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2ef7dadf-3ef7-48b3-8384-e2d89f4b6494 req-883e20e5-7f17-4d45-9c05-77bf193c01c4 service nova] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2ef7dadf-3ef7-48b3-8384-e2d89f4b6494 req-883e20e5-7f17-4d45-9c05-77bf193c01c4 service nova] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:34 user nova-compute[72409]: DEBUG nova.compute.manager [req-2ef7dadf-3ef7-48b3-8384-e2d89f4b6494 req-883e20e5-7f17-4d45-9c05-77bf193c01c4 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] No waiting events found dispatching network-vif-plugged-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:56:34 user nova-compute[72409]: WARNING nova.compute.manager [req-2ef7dadf-3ef7-48b3-8384-e2d89f4b6494 req-883e20e5-7f17-4d45-9c05-77bf193c01c4 service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Received unexpected event network-vif-plugged-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d for instance with vm_state active and task_state deleting.
Aug 09 22:56:34 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:34 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Took 2.07 seconds to deallocate network for instance.
Aug 09 22:56:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "451ed986-57e6-485e-90b1-231c5ea3db20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "451ed986-57e6-485e-90b1-231c5ea3db20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.026s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:35 user nova-compute[72409]: INFO nova.compute.manager [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Terminating instance
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:56:35 user nova-compute[72409]: INFO nova.compute.claims [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Claim successful on node user
Aug 09 22:56:35 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Deleted allocations for instance 5af7f4c7-5937-4b69-831e-941d7de4417d
Aug 09 22:56:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-88303cf5-3e8f-485b-bed9-25bb9e8ef911 tempest-VolumesAdminNegativeTest-994899237 tempest-VolumesAdminNegativeTest-994899237-project-member] Lock "5af7f4c7-5937-4b69-831e-941d7de4417d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.715s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:56:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:56:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Creating image(s)
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "/opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "/opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "/opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:36 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Instance destroyed successfully.
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.objects.instance [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'resources' on Instance uuid 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.policy [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28bd09bfc6304cb398964bbe964878bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37caf02dd0db418cbbdcd1d13349bd53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T22:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1676089071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1676089071',id=3,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWHyfVpg3Kxrgr/EOJ4QW5vmd6tAAdh2btXYWwwgqJOx2vQ/rfQRRsSJSnaWzEo8tufPFyDQFqxKUWgmDvGwm+DH3CFrgPX/YxaD+rKI415YK3kZVdGh13iXzHTaZN+EA==',key_name='tempest-keypair-996093995',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:54:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='894e6764aa794ff29ce4bc213a7def7d',ramdisk_id='',reservation_id='r-e05l9tyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-723310053',owner_user_name='tempest-AttachVolumeShelveTestJSON-723310053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce008676a8de41b8b2ffe79ab31462df',uuid=19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converting VIF {"id": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "address": "fa:16:3e:77:5f:b3", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073bad5c-1f", "ovs_interfaceid": "073bad5c-1f38-4fb0-b4e9-803dd62fcd34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG os_vif [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap073bad5c-1f, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:36 user nova-compute[72409]: INFO os_vif [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:5f:b3,bridge_name='br-int',has_traffic_filtering=True,id=073bad5c-1f38-4fb0-b4e9-803dd62fcd34,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073bad5c-1f')
Aug 09 22:56:36 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Deleting instance files /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8_del
Aug 09 22:56:36 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Deletion of /opt/stack/data/nova/instances/19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8_del complete
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.161s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c282ec2-ecc6-4655-a381-f780b7267b4b req-5bfc78a6-b480-4238-8bbb-0521fbb38e4c service nova] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Received event network-vif-deleted-8eff036f-2f5c-48d9-ae18-f6e1f96b5b8d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c282ec2-ecc6-4655-a381-f780b7267b4b req-5bfc78a6-b480-4238-8bbb-0521fbb38e4c service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-vif-unplugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c282ec2-ecc6-4655-a381-f780b7267b4b req-5bfc78a6-b480-4238-8bbb-0521fbb38e4c service nova] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c282ec2-ecc6-4655-a381-f780b7267b4b req-5bfc78a6-b480-4238-8bbb-0521fbb38e4c service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8c282ec2-ecc6-4655-a381-f780b7267b4b req-5bfc78a6-b480-4238-8bbb-0521fbb38e4c service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c282ec2-ecc6-4655-a381-f780b7267b4b req-5bfc78a6-b480-4238-8bbb-0521fbb38e4c service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] No waiting events found dispatching network-vif-unplugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-8c282ec2-ecc6-4655-a381-f780b7267b4b req-5bfc78a6-b480-4238-8bbb-0521fbb38e4c service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-vif-unplugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:56:36 user nova-compute[72409]: INFO nova.compute.manager [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.159s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk 1073741824" returned: 0 in 0.076s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Checking if we can resize image /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Cannot resize image /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.objects.instance [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lazy-loading 'migration_context' on Instance uuid 451ed986-57e6-485e-90b1-231c5ea3db20 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Ensure instance console log exists: /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:36 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Successfully created port: 9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:56:37 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:37 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Took 1.74 seconds to deallocate network for instance.
Aug 09 22:56:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-26d8427b-ea91-4716-a8c7-0e20879edf94 req-8448fc9d-3891-4887-b62c-6684e97746ed service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-vif-deleted-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Successfully updated port: 9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:56:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "refresh_cache-451ed986-57e6-485e-90b1-231c5ea3db20" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:56:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquired lock "refresh_cache-451ed986-57e6-485e-90b1-231c5ea3db20" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:56:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received event network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] Acquiring lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] No waiting events found dispatching network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:56:38 user nova-compute[72409]: WARNING nova.compute.manager [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Received unexpected event network-vif-plugged-073bad5c-1f38-4fb0-b4e9-803dd62fcd34 for instance with vm_state deleted and task_state None.
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Received event network-changed-9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Refreshing instance network info cache due to event network-changed-9befc7d9-aae4-419f-953b-77e098e43523. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] Acquiring lock "refresh_cache-451ed986-57e6-485e-90b1-231c5ea3db20" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:38 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Deleted allocations for instance 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Updating instance_info_cache with network_info: [{"id": "9befc7d9-aae4-419f-953b-77e098e43523", "address": "fa:16:3e:8c:e0:b9", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9befc7d9-aa", "ovs_interfaceid": "9befc7d9-aae4-419f-953b-77e098e43523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Releasing lock "refresh_cache-451ed986-57e6-485e-90b1-231c5ea3db20" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Instance network_info: |[{"id": "9befc7d9-aae4-419f-953b-77e098e43523", "address": "fa:16:3e:8c:e0:b9", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9befc7d9-aa", "ovs_interfaceid": "9befc7d9-aae4-419f-953b-77e098e43523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] Acquired lock "refresh_cache-451ed986-57e6-485e-90b1-231c5ea3db20" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.network.neutron [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Refreshing network info cache for port 9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Start _get_guest_xml network_info=[{"id": "9befc7d9-aae4-419f-953b-77e098e43523", "address": "fa:16:3e:8c:e0:b9", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9befc7d9-aa", "ovs_interfaceid": "9befc7d9-aae4-419f-953b-77e098e43523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:56:38 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:56:38 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f993821b-824b-4e5a-81da-3b2e0adbef34 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.232s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1026833379',display_name='tempest-ServersNegativeTestJSON-server-1026833379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1026833379',id=20,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37caf02dd0db418cbbdcd1d13349bd53',ramdisk_id='',reservation_id='r-8n6f5jdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-648629170',owner_user_name='tempest-ServersNegativeTestJSON-648629170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:56:36Z,user_data=None,user_id='28bd09bfc6304cb398964bbe964878bf',uuid=451ed986-57e6-485e-90b1-231c5ea3db20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9befc7d9-aae4-419f-953b-77e098e43523", "address": "fa:16:3e:8c:e0:b9", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9befc7d9-aa", "ovs_interfaceid": "9befc7d9-aae4-419f-953b-77e098e43523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Converting VIF {"id": "9befc7d9-aae4-419f-953b-77e098e43523", "address": "fa:16:3e:8c:e0:b9", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9befc7d9-aa", "ovs_interfaceid": "9befc7d9-aae4-419f-953b-77e098e43523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e0:b9,bridge_name='br-int',has_traffic_filtering=True,id=9befc7d9-aae4-419f-953b-77e098e43523,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9befc7d9-aa') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.objects.instance [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lazy-loading 'pci_devices' on Instance uuid 451ed986-57e6-485e-90b1-231c5ea3db20 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:56:38 user nova-compute[72409]:   <uuid>451ed986-57e6-485e-90b1-231c5ea3db20</uuid>
Aug 09 22:56:38 user nova-compute[72409]:   <name>instance-00000014</name>
Aug 09 22:56:38 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:56:38 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:56:38 user nova-compute[72409]:   <metadata>
Aug 09 22:56:38 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:56:38 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:56:38 user nova-compute[72409]:       <nova:name>tempest-ServersNegativeTestJSON-server-1026833379</nova:name>
Aug 09 22:56:38 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:56:38</nova:creationTime>
Aug 09 22:56:38 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:56:38 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:56:38 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:56:38 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:56:38 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:56:38 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:56:38 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:56:38 user nova-compute[72409]:       <nova:owner>
Aug 09 22:56:38 user nova-compute[72409]:         <nova:user uuid="28bd09bfc6304cb398964bbe964878bf">tempest-ServersNegativeTestJSON-648629170-project-member</nova:user>
Aug 09 22:56:38 user nova-compute[72409]:         <nova:project uuid="37caf02dd0db418cbbdcd1d13349bd53">tempest-ServersNegativeTestJSON-648629170</nova:project>
Aug 09 22:56:38 user nova-compute[72409]:       </nova:owner>
Aug 09 22:56:38 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:56:38 user nova-compute[72409]:       <nova:ports>
Aug 09 22:56:38 user nova-compute[72409]:         <nova:port uuid="9befc7d9-aae4-419f-953b-77e098e43523">
Aug 09 22:56:38 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 22:56:38 user nova-compute[72409]:         </nova:port>
Aug 09 22:56:38 user nova-compute[72409]:       </nova:ports>
Aug 09 22:56:38 user nova-compute[72409]:     </nova:instance>
Aug 09 22:56:38 user nova-compute[72409]:   </metadata>
Aug 09 22:56:38 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:56:38 user nova-compute[72409]:     <system>
Aug 09 22:56:38 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:56:38 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:56:38 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:56:38 user nova-compute[72409]:       <entry name="serial">451ed986-57e6-485e-90b1-231c5ea3db20</entry>
Aug 09 22:56:38 user nova-compute[72409]:       <entry name="uuid">451ed986-57e6-485e-90b1-231c5ea3db20</entry>
Aug 09 22:56:38 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:56:38 user nova-compute[72409]:     </system>
Aug 09 22:56:38 user nova-compute[72409]:   </sysinfo>
Aug 09 22:56:38 user nova-compute[72409]:   <os>
Aug 09 22:56:38 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:56:38 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:56:38 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:56:38 user nova-compute[72409]:   </os>
Aug 09 22:56:38 user nova-compute[72409]:   <features>
Aug 09 22:56:38 user nova-compute[72409]:     <acpi/>
Aug 09 22:56:38 user nova-compute[72409]:     <apic/>
Aug 09 22:56:38 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:56:38 user nova-compute[72409]:   </features>
Aug 09 22:56:38 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:56:38 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:56:38 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:56:38 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:56:38 user nova-compute[72409]:   </clock>
Aug 09 22:56:38 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:56:38 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:56:38 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:56:38 user nova-compute[72409]:   </cpu>
Aug 09 22:56:38 user nova-compute[72409]:   <devices>
Aug 09 22:56:38 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:56:38 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:56:38 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk"/>
Aug 09 22:56:38 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:56:38 user nova-compute[72409]:     </disk>
Aug 09 22:56:38 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:56:38 user nova-compute[72409]:       <mac address="fa:16:3e:8c:e0:b9"/>
Aug 09 22:56:38 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:56:38 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:56:38 user nova-compute[72409]:       <target dev="tap9befc7d9-aa"/>
Aug 09 22:56:38 user nova-compute[72409]:     </interface>
Aug 09 22:56:38 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:56:38 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/console.log" append="off"/>
Aug 09 22:56:38 user nova-compute[72409]:     </serial>
Aug 09 22:56:38 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:56:38 user nova-compute[72409]:     <video>
Aug 09 22:56:38 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:56:38 user nova-compute[72409]:     </video>
Aug 09 22:56:38 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:56:38 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:56:38 user nova-compute[72409]:     </rng>
Aug 09 22:56:38 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:56:38 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:56:38 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:56:38 user nova-compute[72409]:     </memballoon>
Aug 09 22:56:38 user nova-compute[72409]:   </devices>
Aug 09 22:56:38 user nova-compute[72409]: </domain>
Aug 09 22:56:38 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1026833379',display_name='tempest-ServersNegativeTestJSON-server-1026833379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1026833379',id=20,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37caf02dd0db418cbbdcd1d13349bd53',ramdisk_id='',reservation_id='r-8n6f5jdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-648629170',owner_user_name='tempest-ServersNegativeTestJSON-648629170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:56:36Z,user_data=None,user_id='28bd09bfc6304cb398964bbe964878bf',uuid=451ed986-57e6-485e-90b1-231c5ea3db20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9befc7d9-aae4-419f-953b-77e098e43523", "address": "fa:16:3e:8c:e0:b9", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9befc7d9-aa", "ovs_interfaceid": "9befc7d9-aae4-419f-953b-77e098e43523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Converting VIF {"id": "9befc7d9-aae4-419f-953b-77e098e43523", "address": "fa:16:3e:8c:e0:b9", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9befc7d9-aa", "ovs_interfaceid": "9befc7d9-aae4-419f-953b-77e098e43523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e0:b9,bridge_name='br-int',has_traffic_filtering=True,id=9befc7d9-aae4-419f-953b-77e098e43523,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9befc7d9-aa') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG os_vif [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e0:b9,bridge_name='br-int',has_traffic_filtering=True,id=9befc7d9-aae4-419f-953b-77e098e43523,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9befc7d9-aa') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9befc7d9-aa, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9befc7d9-aa, col_values=(('external_ids', {'iface-id': '9befc7d9-aae4-419f-953b-77e098e43523', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:e0:b9', 'vm-uuid': '451ed986-57e6-485e-90b1-231c5ea3db20'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:38 user nova-compute[72409]: INFO os_vif [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e0:b9,bridge_name='br-int',has_traffic_filtering=True,id=9befc7d9-aae4-419f-953b-77e098e43523,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9befc7d9-aa')
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] No VIF found with MAC fa:16:3e:8c:e0:b9, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.network.neutron [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Updated VIF entry in instance network info cache for port 9befc7d9-aae4-419f-953b-77e098e43523. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG nova.network.neutron [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Updating instance_info_cache with network_info: [{"id": "9befc7d9-aae4-419f-953b-77e098e43523", "address": "fa:16:3e:8c:e0:b9", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9befc7d9-aa", "ovs_interfaceid": "9befc7d9-aae4-419f-953b-77e098e43523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5a703c3e-4311-4865-8029-6677fb91c7f6 req-dba0cee1-4dd4-459e-b220-2daba5083922 service nova] Releasing lock "refresh_cache-451ed986-57e6-485e-90b1-231c5ea3db20" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:56:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:40 user nova-compute[72409]: DEBUG nova.compute.manager [req-2593cc8b-ff2a-4e2c-8abb-ccc56c05fbf1 req-b3b59e69-f8d8-4f44-879d-c83345bdcf11 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Received event network-vif-plugged-9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2593cc8b-ff2a-4e2c-8abb-ccc56c05fbf1 req-b3b59e69-f8d8-4f44-879d-c83345bdcf11 service nova] Acquiring lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2593cc8b-ff2a-4e2c-8abb-ccc56c05fbf1 req-b3b59e69-f8d8-4f44-879d-c83345bdcf11 service nova] Lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2593cc8b-ff2a-4e2c-8abb-ccc56c05fbf1 req-b3b59e69-f8d8-4f44-879d-c83345bdcf11 service nova] Lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:40 user nova-compute[72409]: DEBUG nova.compute.manager [req-2593cc8b-ff2a-4e2c-8abb-ccc56c05fbf1 req-b3b59e69-f8d8-4f44-879d-c83345bdcf11 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] No waiting events found dispatching network-vif-plugged-9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:56:40 user nova-compute[72409]: WARNING nova.compute.manager [req-2593cc8b-ff2a-4e2c-8abb-ccc56c05fbf1 req-b3b59e69-f8d8-4f44-879d-c83345bdcf11 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Received unexpected event network-vif-plugged-9befc7d9-aae4-419f-953b-77e098e43523 for instance with vm_state building and task_state spawning.
Aug 09 22:56:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-357b7443-0782-47e9-b763-1a2ec104534d req-5ce63b1e-55e7-416f-9036-62bc4ae8775a service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Received event network-vif-plugged-9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-357b7443-0782-47e9-b763-1a2ec104534d req-5ce63b1e-55e7-416f-9036-62bc4ae8775a service nova] Acquiring lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-357b7443-0782-47e9-b763-1a2ec104534d req-5ce63b1e-55e7-416f-9036-62bc4ae8775a service nova] Lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-357b7443-0782-47e9-b763-1a2ec104534d req-5ce63b1e-55e7-416f-9036-62bc4ae8775a service nova] Lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-357b7443-0782-47e9-b763-1a2ec104534d req-5ce63b1e-55e7-416f-9036-62bc4ae8775a service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] No waiting events found dispatching network-vif-plugged-9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:56:42 user nova-compute[72409]: WARNING nova.compute.manager [req-357b7443-0782-47e9-b763-1a2ec104534d req-5ce63b1e-55e7-416f-9036-62bc4ae8775a service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Received unexpected event network-vif-plugged-9befc7d9-aae4-419f-953b-77e098e43523 for instance with vm_state building and task_state spawning.
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621802.4447086, 451ed986-57e6-485e-90b1-231c5ea3db20 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:56:42 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] VM Resumed (Lifecycle Event)
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:56:42 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Instance spawned successfully.
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:56:42 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621802.4479973, 451ed986-57e6-485e-90b1-231c5ea3db20 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:56:42 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] VM Started (Lifecycle Event)
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:56:42 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:56:42 user nova-compute[72409]: INFO nova.compute.manager [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Took 6.65 seconds to spawn the instance on the hypervisor.
Aug 09 22:56:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:56:42 user nova-compute[72409]: INFO nova.compute.manager [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Took 7.54 seconds to build instance.
Aug 09 22:56:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0bcf1804-ee96-4d27-8482-e63677dab50d tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "451ed986-57e6-485e-90b1-231c5ea3db20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.726s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "6540903a-e102-40b3-833b-1ec5031c6d82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:56:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:45 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:56:45 user nova-compute[72409]: INFO nova.compute.claims [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Claim successful on node user
Aug 09 22:56:46 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:56:46 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:56:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:56:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:56:46 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:56:46 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:56:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:56:46 user nova-compute[72409]: INFO nova.virt.block_device [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Booting with volume-backed-image 1f9d9956-e987-40f0-9bbf-df1fe47ca751 at /dev/vda
Aug 09 22:56:46 user nova-compute[72409]: DEBUG nova.policy [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bf771a74e994703bd1ed49add72cd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dfbbb5a1d134adba458e9c592f6fada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:56:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:47 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Successfully created port: 0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:56:47 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621792.5306768, 5af7f4c7-5937-4b69-831e-941d7de4417d => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:56:47 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] VM Stopped (Lifecycle Event)
Aug 09 22:56:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-5755af8c-0d6c-4eae-943b-a2cf71a4ab06 None None] [instance: 5af7f4c7-5937-4b69-831e-941d7de4417d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Successfully updated port: 0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "refresh_cache-6540903a-e102-40b3-833b-1ec5031c6d82" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquired lock "refresh_cache-6540903a-e102-40b3-833b-1ec5031c6d82" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG nova.compute.manager [req-5cc1baf1-d255-4615-a2cc-8025b2ebdb00 req-5be5e881-fb5c-49e8-bdbc-42ab2ff25031 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-changed-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG nova.compute.manager [req-5cc1baf1-d255-4615-a2cc-8025b2ebdb00 req-5be5e881-fb5c-49e8-bdbc-42ab2ff25031 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Refreshing instance network info cache due to event network-changed-0183f9ca-8c9d-4077-adfc-1d80ec039ba4. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5cc1baf1-d255-4615-a2cc-8025b2ebdb00 req-5be5e881-fb5c-49e8-bdbc-42ab2ff25031 service nova] Acquiring lock "refresh_cache-6540903a-e102-40b3-833b-1ec5031c6d82" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:56:48 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:56:49 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Updating instance_info_cache with network_info: [{"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Releasing lock "refresh_cache-6540903a-e102-40b3-833b-1ec5031c6d82" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:56:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Instance network_info: |[{"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:56:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5cc1baf1-d255-4615-a2cc-8025b2ebdb00 req-5be5e881-fb5c-49e8-bdbc-42ab2ff25031 service nova] Acquired lock "refresh_cache-6540903a-e102-40b3-833b-1ec5031c6d82" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:56:49 user nova-compute[72409]: DEBUG nova.network.neutron [req-5cc1baf1-d255-4615-a2cc-8025b2ebdb00 req-5be5e881-fb5c-49e8-bdbc-42ab2ff25031 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Refreshing network info cache for port 0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:56:49 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG nova.network.neutron [req-5cc1baf1-d255-4615-a2cc-8025b2ebdb00 req-5be5e881-fb5c-49e8-bdbc-42ab2ff25031 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Updated VIF entry in instance network info cache for port 0183f9ca-8c9d-4077-adfc-1d80ec039ba4. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG nova.network.neutron [req-5cc1baf1-d255-4615-a2cc-8025b2ebdb00 req-5be5e881-fb5c-49e8-bdbc-42ab2ff25031 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Updating instance_info_cache with network_info: [{"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5cc1baf1-d255-4615-a2cc-8025b2ebdb00 req-5be5e881-fb5c-49e8-bdbc-42ab2ff25031 service nova] Releasing lock "refresh_cache-6540903a-e102-40b3-833b-1ec5031c6d82" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:56:50 user nova-compute[72409]: INFO nova.compute.claims [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Claim successful on node user
Aug 09 22:56:50 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:56:50 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:56:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:56:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:56:51 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621796.049349, 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:56:51 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] VM Stopped (Lifecycle Event)
Aug 09 22:56:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4b59976a-2868-42f1-a760-f60a7a912d34 None None] [instance: 19b74fa8-6d9c-4ffe-a3db-cb9f99bce7c8] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:56:51 user nova-compute[72409]: INFO nova.virt.block_device [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Booting with volume snapshot 85814cfc-cd85-440f-976f-96e9f3dea80b at /dev/vda
Aug 09 22:56:51 user nova-compute[72409]: DEBUG nova.policy [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd5e2f13e0a448e836dd8684b889a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d29522bd16460eb1edc9fb7918111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:56:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:52 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Successfully created port: d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:56:52 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:56:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:52 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Successfully updated port: d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "refresh_cache-e91a0018-b2f9-4ddf-b082-4b50d815ca54" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquired lock "refresh_cache-e91a0018-b2f9-4ddf-b082-4b50d815ca54" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG nova.compute.manager [req-f5aa488b-fce4-4713-ad51-154808e97683 req-b5e11127-ec98-4b6c-9678-18da959d861d service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Received event network-changed-d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG nova.compute.manager [req-f5aa488b-fce4-4713-ad51-154808e97683 req-b5e11127-ec98-4b6c-9678-18da959d861d service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Refreshing instance network info cache due to event network-changed-d0a9be1b-f3b7-409a-8b27-d39ad6529435. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f5aa488b-fce4-4713-ad51-154808e97683 req-b5e11127-ec98-4b6c-9678-18da959d861d service nova] Acquiring lock "refresh_cache-e91a0018-b2f9-4ddf-b082-4b50d815ca54" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Updating instance_info_cache with network_info: [{"id": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "address": "fa:16:3e:c3:3d:43", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a9be1b-f3", "ovs_interfaceid": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Releasing lock "refresh_cache-e91a0018-b2f9-4ddf-b082-4b50d815ca54" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Instance network_info: |[{"id": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "address": "fa:16:3e:c3:3d:43", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a9be1b-f3", "ovs_interfaceid": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f5aa488b-fce4-4713-ad51-154808e97683 req-b5e11127-ec98-4b6c-9678-18da959d861d service nova] Acquired lock "refresh_cache-e91a0018-b2f9-4ddf-b082-4b50d815ca54" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG nova.network.neutron [req-f5aa488b-fce4-4713-ad51-154808e97683 req-b5e11127-ec98-4b6c-9678-18da959d861d service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Refreshing network info cache for port d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG nova.network.neutron [req-f5aa488b-fce4-4713-ad51-154808e97683 req-b5e11127-ec98-4b6c-9678-18da959d861d service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Updated VIF entry in instance network info cache for port d0a9be1b-f3b7-409a-8b27-d39ad6529435. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG nova.network.neutron [req-f5aa488b-fce4-4713-ad51-154808e97683 req-b5e11127-ec98-4b6c-9678-18da959d861d service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Updating instance_info_cache with network_info: [{"id": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "address": "fa:16:3e:c3:3d:43", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a9be1b-f3", "ovs_interfaceid": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f5aa488b-fce4-4713-ad51-154808e97683 req-b5e11127-ec98-4b6c-9678-18da959d861d service nova] Releasing lock "refresh_cache-e91a0018-b2f9-4ddf-b082-4b50d815ca54" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:55 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:56:55 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:56:55 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7731MB free_disk=25.571308135986328GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:56:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:56:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5b7906a3-e02b-49a3-9a56-fc34a8730238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c17c9b77-8e04-432c-9634-c4bee2eb8889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 122c668a-56c6-46b0-9e1f-2f39bdea7418 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c513e397-28f7-4d93-8487-257becbef9d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 451ed986-57e6-485e-90b1-231c5ea3db20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 6540903a-e102-40b3-833b-1ec5031c6d82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance e91a0018-b2f9-4ddf-b082-4b50d815ca54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:56:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG os_brick.utils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ac5e4a-1d57-4beb-b631-e81000cc72c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aaa9d0-71d1-4cb7-9427-593546170144]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.046s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[638ea1c4-5b63-47f1-ac87-2022b0176234]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc4c26a-a5d3-47c9-8860-27a03488c181]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:56:57 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4248ef-e30d-4381-973b-3f0bc938db1c]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG os_brick.utils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Updating existing volume attachment record: 2ac3d190-68c5-4014-b429-f2ae39a29b26 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-5b7906a3-e02b-49a3-9a56-fc34a8730238" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-5b7906a3-e02b-49a3-9a56-fc34a8730238" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:56:57 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 22:56:58 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Updating instance_info_cache with network_info: [{"id": "a3239f85-cc45-49f5-97a6-b936267579a8", "address": "fa:16:3e:00:16:76", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3239f85-cc", "ovs_interfaceid": "a3239f85-cc45-49f5-97a6-b936267579a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:56:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-5b7906a3-e02b-49a3-9a56-fc34a8730238" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:56:58 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 22:56:58 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:56:58 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:56:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:56:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG os_brick.utils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf2d774-7f3c-427f-ad0a-2d5373503589]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[381dfe77-e9f8-44ab-91d4-4a56d6dc5c74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[574dd7bb-0465-45f7-a09a-3ad5ba22bd0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e01b324-2c1b-42c7-884f-1938399bf0db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:57:02 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:57:02 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb68ee1-c56b-440e-a0a8-f11b3db88736]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG os_brick.utils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Updating existing volume attachment record: b11cf086-8a65-4c1e-9e75-c196324df607 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "122c668a-56c6-46b0-9e1f-2f39bdea7418" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:02 user nova-compute[72409]: INFO nova.compute.manager [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Terminating instance
Aug 09 22:57:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-7cc1fd94-46bc-4f05-a133-61985d241e0e req-0ad0b420-050b-4704-b2a7-8f11890c61b8 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Received event network-vif-unplugged-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7cc1fd94-46bc-4f05-a133-61985d241e0e req-0ad0b420-050b-4704-b2a7-8f11890c61b8 service nova] Acquiring lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7cc1fd94-46bc-4f05-a133-61985d241e0e req-0ad0b420-050b-4704-b2a7-8f11890c61b8 service nova] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7cc1fd94-46bc-4f05-a133-61985d241e0e req-0ad0b420-050b-4704-b2a7-8f11890c61b8 service nova] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-7cc1fd94-46bc-4f05-a133-61985d241e0e req-0ad0b420-050b-4704-b2a7-8f11890c61b8 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] No waiting events found dispatching network-vif-unplugged-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-7cc1fd94-46bc-4f05-a133-61985d241e0e req-0ad0b420-050b-4704-b2a7-8f11890c61b8 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Received event network-vif-unplugged-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:57:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Instance destroyed successfully.
Aug 09 22:57:02 user nova-compute[72409]: DEBUG nova.objects.instance [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lazy-loading 'resources' on Instance uuid 122c668a-56c6-46b0-9e1f-2f39bdea7418 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:55:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-808866618',display_name='tempest-VolumesActionsTest-instance-808866618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-808866618',id=18,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:55:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa953a0836e54254a4917555ccf838a1',ramdisk_id='',reservation_id='r-2lmlxztr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-24018393',owner_user_name='tempest-VolumesActionsTest-24018393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:55:20Z,user_data=None,user_id='8fa331e6178145b5b9a0d07a4b4a4d63',uuid=122c668a-56c6-46b0-9e1f-2f39bdea7418,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "address": "fa:16:3e:49:d2:84", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591d4f95-4e", "ovs_interfaceid": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Converting VIF {"id": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "address": "fa:16:3e:49:d2:84", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591d4f95-4e", "ovs_interfaceid": "591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591d4f95-4e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG os_vif [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591d4f95-4e') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap591d4f95-4e, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:57:02 user nova-compute[72409]: INFO os_vif [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:d2:84,bridge_name='br-int',has_traffic_filtering=True,id=591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591d4f95-4e')
Aug 09 22:57:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Deleting instance files /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418_del
Aug 09 22:57:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Deletion of /opt/stack/data/nova/instances/122c668a-56c6-46b0-9e1f-2f39bdea7418_del complete
Aug 09 22:57:02 user nova-compute[72409]: INFO nova.compute.manager [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 09 22:57:02 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:57:02 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:57:03 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:57:03 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Took 0.53 seconds to deallocate network for instance.
Aug 09 22:57:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-c2b67d00-3f94-4e5b-90e8-9d5ef9748b86 req-8df1e1be-5fbe-473d-b2a0-d422267b1ccf service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Received event network-vif-deleted-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:03 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:57:03 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:57:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:03 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Deleted allocations for instance 122c668a-56c6-46b0-9e1f-2f39bdea7418
Aug 09 22:57:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-32af804d-1139-49fe-a5cf-178e4ece2371 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.928s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-08cee6bf-1cc5-4c42-9510-c932135a917a req-779ae994-6bc5-41ed-b9b6-acd8acd0cec4 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Received event network-vif-plugged-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-08cee6bf-1cc5-4c42-9510-c932135a917a req-779ae994-6bc5-41ed-b9b6-acd8acd0cec4 service nova] Acquiring lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-08cee6bf-1cc5-4c42-9510-c932135a917a req-779ae994-6bc5-41ed-b9b6-acd8acd0cec4 service nova] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-08cee6bf-1cc5-4c42-9510-c932135a917a req-779ae994-6bc5-41ed-b9b6-acd8acd0cec4 service nova] Lock "122c668a-56c6-46b0-9e1f-2f39bdea7418-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-08cee6bf-1cc5-4c42-9510-c932135a917a req-779ae994-6bc5-41ed-b9b6-acd8acd0cec4 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] No waiting events found dispatching network-vif-plugged-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:57:04 user nova-compute[72409]: WARNING nova.compute.manager [req-08cee6bf-1cc5-4c42-9510-c932135a917a req-779ae994-6bc5-41ed-b9b6-acd8acd0cec4 service nova] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Received unexpected event network-vif-plugged-591d4f95-4ea6-4d77-bb0e-6e4fb3ae6725 for instance with vm_state deleted and task_state None.
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:57:06 user nova-compute[72409]: INFO nova.compute.claims [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Claim successful on node user
Aug 09 22:57:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.network.neutron [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:57:06 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:57:06 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Creating image(s)
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Ensure instance console log exists: /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Start _get_guest_xml network_info=[{"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGgyDOwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6540903a-e102-40b3-833b-1ec5031c6d82', 'attached_at': '', 'detached_at': '', 'volume_id': '2415b285-e97f-4c81-b5f8-06481a7d094c', 'serial': '2415b285-e97f-4c81-b5f8-06481a7d094c'}, 'mount_device': '/dev/vda', 'attachment_id': '2ac3d190-68c5-4014-b429-f2ae39a29b26', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:57:06 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:57:06 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGgyDOwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:57:06 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:57:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:57:06 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:57:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:57:06 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd85c54-ae8a-4a2b-bf64-5ddf5b8d5741]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:57:06 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.066s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3c0abc-e911-4522-87be-bebfb55b7432]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c] added
Aug 09 22:57:06 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:57:06 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Creating image(s)
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "/opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "/opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "/opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "7977736307184a100b6a8584762f6eb9f96557b7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "7977736307184a100b6a8584762f6eb9f96557b7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c62e842-8818-4e89-9703-50cff36ec90f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG nova.policy [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8411ad4a2fdd412783da8516d860cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb0e0790757422da3f43722e4bd554e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a008cdae-16e6-48be-9445-c0ef03e4fd34]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGgyDOwZ {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7.part --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGgyDOwZ" returned: 0 in 0.039s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3c6ad8-3510-42b6-be87-588bc8dcdba2]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xGgyDOwZ'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02f0967-5f26-44b2-8850-075eed3fad9d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c40477-9dbf-4cdd-8f16-d1d9f3c546ec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 22:57:07 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 22:57:07 user nova-compute[72409]:  {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:57:07 user nova-compute[72409]: WARNING os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 22:57:07 user nova-compute[72409]: 
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7.part --force-share --output=json" returned: 0 in 0.169s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG nova.virt.images [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] c98b41c3-c55f-4611-b915-f71a20d77fa8 was qcow2, converting to raw {{(pid=72409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7.part /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7.converted {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee487a0f-eb93-47da-b1b0-e32cc99d4ae4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c, portal: 172.16.0.220,3260]
Aug 09 22:57:07 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c, portal: 172.16.0.220,3260] successful.
Aug 09 22:57:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f381bd0-0b62-47de-9d98-6a3199138058]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c2def2-6ed2-403f-b490-d79b1c18d009]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:57:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:57:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.884s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[64502fea-216c-4d79-9ece-09b4a71b04a0]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGgyDOwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7.part /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7.converted" returned: 0 in 0.242s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7.converted --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "7977736307184a100b6a8584762f6eb9f96557b7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.136s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.compute.manager [req-9d620a3b-2e78-4304-b21a-d9f65c4d11f7 req-fdad0eb0-3a78-4f81-8cf5-34888fab1803 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-changed-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.compute.manager [req-9d620a3b-2e78-4304-b21a-d9f65c4d11f7 req-fdad0eb0-3a78-4f81-8cf5-34888fab1803 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Refreshing instance network info cache due to event network-changed-6afaf787-02f9-400f-b7a9-b0aa4df58939. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9d620a3b-2e78-4304-b21a-d9f65c4d11f7 req-fdad0eb0-3a78-4f81-8cf5-34888fab1803 service nova] Acquiring lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9d620a3b-2e78-4304-b21a-d9f65c4d11f7 req-fdad0eb0-3a78-4f81-8cf5-34888fab1803 service nova] Acquired lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.network.neutron [req-9d620a3b-2e78-4304-b21a-d9f65c4d11f7 req-fdad0eb0-3a78-4f81-8cf5-34888fab1803 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Refreshing network info cache for port 6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7 --force-share --output=json" returned: 0 in 0.162s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "7977736307184a100b6a8584762f6eb9f96557b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "7977736307184a100b6a8584762f6eb9f96557b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7 --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7,backing_fmt=raw /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7,backing_fmt=raw /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk 1073741824" returned: 0 in 0.054s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "7977736307184a100b6a8584762f6eb9f96557b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.network.neutron [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Successfully created port: d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7 --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Cannot resize image /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'migration_context' on Instance uuid 65d39a39-3616-40db-906b-d4327e1d63c5 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.925s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] <== connect_volume: return (1927ms) {'type': 'block', 'scsi_wwn': '23239336465383561', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239336465383561', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Ensure instance console log exists: /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-360915832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-360915832',id=21,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dfbbb5a1d134adba458e9c592f6fada',ramdisk_id='',reservation_id='r-cwymbw5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-426575742',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:56:46Z,user_data=None,user_id='8bf771a74e994703bd1ed49add72cd14',uuid=6540903a-e102-40b3-833b-1ec5031c6d82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converting VIF {"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=0183f9ca-8c9d-4077-adfc-1d80ec039ba4,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0183f9ca-8c') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'pci_devices' on Instance uuid 6540903a-e102-40b3-833b-1ec5031c6d82 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:57:08 user nova-compute[72409]:   <uuid>6540903a-e102-40b3-833b-1ec5031c6d82</uuid>
Aug 09 22:57:08 user nova-compute[72409]:   <name>instance-00000015</name>
Aug 09 22:57:08 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:57:08 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:57:08 user nova-compute[72409]:   <metadata>
Aug 09 22:57:08 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:57:08 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:57:08 user nova-compute[72409]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-360915832</nova:name>
Aug 09 22:57:08 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:57:06</nova:creationTime>
Aug 09 22:57:08 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:57:08 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:57:08 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:57:08 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:57:08 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:57:08 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:57:08 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:57:08 user nova-compute[72409]:       <nova:owner>
Aug 09 22:57:08 user nova-compute[72409]:         <nova:user uuid="8bf771a74e994703bd1ed49add72cd14">tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member</nova:user>
Aug 09 22:57:08 user nova-compute[72409]:         <nova:project uuid="7dfbbb5a1d134adba458e9c592f6fada">tempest-ServerBootFromVolumeStableRescueTest-426575742</nova:project>
Aug 09 22:57:08 user nova-compute[72409]:       </nova:owner>
Aug 09 22:57:08 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:57:08 user nova-compute[72409]:       <nova:ports>
Aug 09 22:57:08 user nova-compute[72409]:         <nova:port uuid="0183f9ca-8c9d-4077-adfc-1d80ec039ba4">
Aug 09 22:57:08 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 22:57:08 user nova-compute[72409]:         </nova:port>
Aug 09 22:57:08 user nova-compute[72409]:       </nova:ports>
Aug 09 22:57:08 user nova-compute[72409]:     </nova:instance>
Aug 09 22:57:08 user nova-compute[72409]:   </metadata>
Aug 09 22:57:08 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:57:08 user nova-compute[72409]:     <system>
Aug 09 22:57:08 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:57:08 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:57:08 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:57:08 user nova-compute[72409]:       <entry name="serial">6540903a-e102-40b3-833b-1ec5031c6d82</entry>
Aug 09 22:57:08 user nova-compute[72409]:       <entry name="uuid">6540903a-e102-40b3-833b-1ec5031c6d82</entry>
Aug 09 22:57:08 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:57:08 user nova-compute[72409]:     </system>
Aug 09 22:57:08 user nova-compute[72409]:   </sysinfo>
Aug 09 22:57:08 user nova-compute[72409]:   <os>
Aug 09 22:57:08 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:57:08 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:57:08 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:57:08 user nova-compute[72409]:   </os>
Aug 09 22:57:08 user nova-compute[72409]:   <features>
Aug 09 22:57:08 user nova-compute[72409]:     <acpi/>
Aug 09 22:57:08 user nova-compute[72409]:     <apic/>
Aug 09 22:57:08 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:57:08 user nova-compute[72409]:   </features>
Aug 09 22:57:08 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:57:08 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:57:08 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:57:08 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:57:08 user nova-compute[72409]:   </clock>
Aug 09 22:57:08 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:57:08 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:57:08 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:57:08 user nova-compute[72409]:   </cpu>
Aug 09 22:57:08 user nova-compute[72409]:   <devices>
Aug 09 22:57:08 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:57:08 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:57:08 user nova-compute[72409]:       <source dev="/dev/sdb"/>
Aug 09 22:57:08 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:57:08 user nova-compute[72409]:       <serial>2415b285-e97f-4c81-b5f8-06481a7d094c</serial>
Aug 09 22:57:08 user nova-compute[72409]:     </disk>
Aug 09 22:57:08 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:57:08 user nova-compute[72409]:       <mac address="fa:16:3e:4b:b8:45"/>
Aug 09 22:57:08 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:57:08 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:57:08 user nova-compute[72409]:       <target dev="tap0183f9ca-8c"/>
Aug 09 22:57:08 user nova-compute[72409]:     </interface>
Aug 09 22:57:08 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:57:08 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/console.log" append="off"/>
Aug 09 22:57:08 user nova-compute[72409]:     </serial>
Aug 09 22:57:08 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:57:08 user nova-compute[72409]:     <video>
Aug 09 22:57:08 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:57:08 user nova-compute[72409]:     </video>
Aug 09 22:57:08 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:57:08 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:57:08 user nova-compute[72409]:     </rng>
Aug 09 22:57:08 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:57:08 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:57:08 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:57:08 user nova-compute[72409]:     </memballoon>
Aug 09 22:57:08 user nova-compute[72409]:   </devices>
Aug 09 22:57:08 user nova-compute[72409]: </domain>
Aug 09 22:57:08 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-360915832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-360915832',id=21,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dfbbb5a1d134adba458e9c592f6fada',ramdisk_id='',reservation_id='r-cwymbw5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-426575742',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:56:46Z,user_data=None,user_id='8bf771a74e994703bd1ed49add72cd14',uuid=6540903a-e102-40b3-833b-1ec5031c6d82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converting VIF {"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=0183f9ca-8c9d-4077-adfc-1d80ec039ba4,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0183f9ca-8c') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG os_vif [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=0183f9ca-8c9d-4077-adfc-1d80ec039ba4,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0183f9ca-8c') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.network.neutron [req-9d620a3b-2e78-4304-b21a-d9f65c4d11f7 req-fdad0eb0-3a78-4f81-8cf5-34888fab1803 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updated VIF entry in instance network info cache for port 6afaf787-02f9-400f-b7a9-b0aa4df58939. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG nova.network.neutron [req-9d620a3b-2e78-4304-b21a-d9f65c4d11f7 req-fdad0eb0-3a78-4f81-8cf5-34888fab1803 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating instance_info_cache with network_info: [{"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0183f9ca-8c, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0183f9ca-8c, col_values=(('external_ids', {'iface-id': '0183f9ca-8c9d-4077-adfc-1d80ec039ba4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:b8:45', 'vm-uuid': '6540903a-e102-40b3-833b-1ec5031c6d82'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9d620a3b-2e78-4304-b21a-d9f65c4d11f7 req-fdad0eb0-3a78-4f81-8cf5-34888fab1803 service nova] Releasing lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:57:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:08 user nova-compute[72409]: INFO os_vif [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=0183f9ca-8c9d-4077-adfc-1d80ec039ba4,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0183f9ca-8c')
Aug 09 22:57:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:57:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] No VIF found with MAC fa:16:3e:4b:b8:45, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Successfully updated port: d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquired lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-db298126-4a3d-43c9-86d7-0d7a60c9acab req-8bfcdc18-6e38-4ca9-8850-f78b220709ed service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-changed-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-db298126-4a3d-43c9-86d7-0d7a60c9acab req-8bfcdc18-6e38-4ca9-8850-f78b220709ed service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Refreshing instance network info cache due to event network-changed-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-db298126-4a3d-43c9-86d7-0d7a60c9acab req-8bfcdc18-6e38-4ca9-8850-f78b220709ed service nova] Acquiring lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-3afe60de-62c4-4f1b-8d9e-98bb5420c0c5 req-ee9f6a3a-d922-4f33-8f48-b7329472bcf8 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3afe60de-62c4-4f1b-8d9e-98bb5420c0c5 req-ee9f6a3a-d922-4f33-8f48-b7329472bcf8 service nova] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3afe60de-62c4-4f1b-8d9e-98bb5420c0c5 req-ee9f6a3a-d922-4f33-8f48-b7329472bcf8 service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3afe60de-62c4-4f1b-8d9e-98bb5420c0c5 req-ee9f6a3a-d922-4f33-8f48-b7329472bcf8 service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-3afe60de-62c4-4f1b-8d9e-98bb5420c0c5 req-ee9f6a3a-d922-4f33-8f48-b7329472bcf8 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] No waiting events found dispatching network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:57:10 user nova-compute[72409]: WARNING nova.compute.manager [req-3afe60de-62c4-4f1b-8d9e-98bb5420c0c5 req-ee9f6a3a-d922-4f33-8f48-b7329472bcf8 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received unexpected event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 for instance with vm_state building and task_state spawning.
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updating instance_info_cache with network_info: [{"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Releasing lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Instance network_info: |[{"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-db298126-4a3d-43c9-86d7-0d7a60c9acab req-8bfcdc18-6e38-4ca9-8850-f78b220709ed service nova] Acquired lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.network.neutron [req-db298126-4a3d-43c9-86d7-0d7a60c9acab req-8bfcdc18-6e38-4ca9-8850-f78b220709ed service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Refreshing network info cache for port d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Start _get_guest_xml network_info=[{"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:57:03Z,direct_url=<?>,disk_format='qcow2',id=c98b41c3-c55f-4611-b915-f71a20d77fa8,min_disk=0,min_ram=0,name='tempest-scenario-img--2142634989',owner='2fb0e0790757422da3f43722e4bd554e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:57:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': 'c98b41c3-c55f-4611-b915-f71a20d77fa8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:57:10 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:57:10 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:57:03Z,direct_url=<?>,disk_format='qcow2',id=c98b41c3-c55f-4611-b915-f71a20d77fa8,min_disk=0,min_ram=0,name='tempest-scenario-img--2142634989',owner='2fb0e0790757422da3f43722e4bd554e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:57:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412508005',display_name='tempest-TestMinimumBasicScenario-server-1412508005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412508005',id=23,image_ref='c98b41c3-c55f-4611-b915-f71a20d77fa8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHNfX9MWZkMyzioX/sWVa4s+rtfVlh+5vlMYHbjyIYluYUUgKRn1OlJBpE2A4bNlZRpcJprB0f1Qwc07KLZ2pODQGZBILXeMZIeBIyMkusp4+aJ6bbTIINp1QC0dSUmgQ==',key_name='tempest-TestMinimumBasicScenario-1519007605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fb0e0790757422da3f43722e4bd554e',ramdisk_id='',reservation_id='r-uxli3rx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c98b41c3-c55f-4611-b915-f71a20d77fa8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1632899528',owner_user_name='tempest-TestMinimumBasicScenario-1632899528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:57:07Z,user_data=None,user_id='8411ad4a2fdd412783da8516d860cccb',uuid=65d39a39-3616-40db-906b-d4327e1d63c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converting VIF {"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'pci_devices' on Instance uuid 65d39a39-3616-40db-906b-d4327e1d63c5 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:57:10 user nova-compute[72409]:   <uuid>65d39a39-3616-40db-906b-d4327e1d63c5</uuid>
Aug 09 22:57:10 user nova-compute[72409]:   <name>instance-00000017</name>
Aug 09 22:57:10 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:57:10 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:57:10 user nova-compute[72409]:   <metadata>
Aug 09 22:57:10 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:57:10 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:57:10 user nova-compute[72409]:       <nova:name>tempest-TestMinimumBasicScenario-server-1412508005</nova:name>
Aug 09 22:57:10 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:57:10</nova:creationTime>
Aug 09 22:57:10 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:57:10 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:57:10 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:57:10 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:57:10 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:57:10 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:57:10 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:57:10 user nova-compute[72409]:       <nova:owner>
Aug 09 22:57:10 user nova-compute[72409]:         <nova:user uuid="8411ad4a2fdd412783da8516d860cccb">tempest-TestMinimumBasicScenario-1632899528-project-member</nova:user>
Aug 09 22:57:10 user nova-compute[72409]:         <nova:project uuid="2fb0e0790757422da3f43722e4bd554e">tempest-TestMinimumBasicScenario-1632899528</nova:project>
Aug 09 22:57:10 user nova-compute[72409]:       </nova:owner>
Aug 09 22:57:10 user nova-compute[72409]:       <nova:root type="image" uuid="c98b41c3-c55f-4611-b915-f71a20d77fa8"/>
Aug 09 22:57:10 user nova-compute[72409]:       <nova:ports>
Aug 09 22:57:10 user nova-compute[72409]:         <nova:port uuid="d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d">
Aug 09 22:57:10 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 22:57:10 user nova-compute[72409]:         </nova:port>
Aug 09 22:57:10 user nova-compute[72409]:       </nova:ports>
Aug 09 22:57:10 user nova-compute[72409]:     </nova:instance>
Aug 09 22:57:10 user nova-compute[72409]:   </metadata>
Aug 09 22:57:10 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:57:10 user nova-compute[72409]:     <system>
Aug 09 22:57:10 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:57:10 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:57:10 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:57:10 user nova-compute[72409]:       <entry name="serial">65d39a39-3616-40db-906b-d4327e1d63c5</entry>
Aug 09 22:57:10 user nova-compute[72409]:       <entry name="uuid">65d39a39-3616-40db-906b-d4327e1d63c5</entry>
Aug 09 22:57:10 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:57:10 user nova-compute[72409]:     </system>
Aug 09 22:57:10 user nova-compute[72409]:   </sysinfo>
Aug 09 22:57:10 user nova-compute[72409]:   <os>
Aug 09 22:57:10 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:57:10 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:57:10 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:57:10 user nova-compute[72409]:   </os>
Aug 09 22:57:10 user nova-compute[72409]:   <features>
Aug 09 22:57:10 user nova-compute[72409]:     <acpi/>
Aug 09 22:57:10 user nova-compute[72409]:     <apic/>
Aug 09 22:57:10 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:57:10 user nova-compute[72409]:   </features>
Aug 09 22:57:10 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:57:10 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:57:10 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:57:10 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:57:10 user nova-compute[72409]:   </clock>
Aug 09 22:57:10 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:57:10 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:57:10 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:57:10 user nova-compute[72409]:   </cpu>
Aug 09 22:57:10 user nova-compute[72409]:   <devices>
Aug 09 22:57:10 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:57:10 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:57:10 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk"/>
Aug 09 22:57:10 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:57:10 user nova-compute[72409]:     </disk>
Aug 09 22:57:10 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:57:10 user nova-compute[72409]:       <mac address="fa:16:3e:04:8a:27"/>
Aug 09 22:57:10 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:57:10 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:57:10 user nova-compute[72409]:       <target dev="tapd8fb0a70-5e"/>
Aug 09 22:57:10 user nova-compute[72409]:     </interface>
Aug 09 22:57:10 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:57:10 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/console.log" append="off"/>
Aug 09 22:57:10 user nova-compute[72409]:     </serial>
Aug 09 22:57:10 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:57:10 user nova-compute[72409]:     <video>
Aug 09 22:57:10 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:57:10 user nova-compute[72409]:     </video>
Aug 09 22:57:10 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:57:10 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:57:10 user nova-compute[72409]:     </rng>
Aug 09 22:57:10 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:57:10 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:57:10 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:57:10 user nova-compute[72409]:     </memballoon>
Aug 09 22:57:10 user nova-compute[72409]:   </devices>
Aug 09 22:57:10 user nova-compute[72409]: </domain>
Aug 09 22:57:10 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412508005',display_name='tempest-TestMinimumBasicScenario-server-1412508005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412508005',id=23,image_ref='c98b41c3-c55f-4611-b915-f71a20d77fa8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHNfX9MWZkMyzioX/sWVa4s+rtfVlh+5vlMYHbjyIYluYUUgKRn1OlJBpE2A4bNlZRpcJprB0f1Qwc07KLZ2pODQGZBILXeMZIeBIyMkusp4+aJ6bbTIINp1QC0dSUmgQ==',key_name='tempest-TestMinimumBasicScenario-1519007605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fb0e0790757422da3f43722e4bd554e',ramdisk_id='',reservation_id='r-uxli3rx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c98b41c3-c55f-4611-b915-f71a20d77fa8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1632899528',owner_user_name='tempest-TestMinimumBasicScenario-1632899528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:57:07Z,user_data=None,user_id='8411ad4a2fdd412783da8516d860cccb',uuid=65d39a39-3616-40db-906b-d4327e1d63c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converting VIF {"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG os_vif [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8fb0a70-5e, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8fb0a70-5e, col_values=(('external_ids', {'iface-id': 'd8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:8a:27', 'vm-uuid': '65d39a39-3616-40db-906b-d4327e1d63c5'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:10 user nova-compute[72409]: INFO os_vif [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e')
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:57:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] No VIF found with MAC fa:16:3e:04:8a:27, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:57:11 user nova-compute[72409]: DEBUG nova.network.neutron [req-db298126-4a3d-43c9-86d7-0d7a60c9acab req-8bfcdc18-6e38-4ca9-8850-f78b220709ed service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updated VIF entry in instance network info cache for port d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:57:11 user nova-compute[72409]: DEBUG nova.network.neutron [req-db298126-4a3d-43c9-86d7-0d7a60c9acab req-8bfcdc18-6e38-4ca9-8850-f78b220709ed service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updating instance_info_cache with network_info: [{"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:57:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-db298126-4a3d-43c9-86d7-0d7a60c9acab req-8bfcdc18-6e38-4ca9-8850-f78b220709ed service nova] Releasing lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:57:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:57:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Creating image(s)
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Ensure instance console log exists: /opt/stack/data/nova/instances/e91a0018-b2f9-4ddf-b082-4b50d815ca54/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Start _get_guest_xml network_info=[{"id": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "address": "fa:16:3e:c3:3d:43", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a9be1b-f3", "ovs_interfaceid": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjyMNkiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e91a0018-b2f9-4ddf-b082-4b50d815ca54', 'attached_at': '', 'detached_at': '', 'volume_id': '48aa5554-7233-4acf-92d3-c7df72698767', 'serial': '48aa5554-7233-4acf-92d3-c7df72698767'}, 'mount_device': '/dev/vda', 'attachment_id': 'b11cf086-8a65-4c1e-9e75-c196324df607', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:57:12 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:57:12 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjyMNkiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:57:12 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:57:12 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:57:12 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[928b4eaf-41e1-452c-a2da-a135ef4bbcd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:57:12 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1532cf-4807-4f06-a11c-c60b7ce38373]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767] added
Aug 09 22:57:12 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e06225-ee96-4325-84c2-d2b81795331c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6113b8e2-a19e-48b7-9e00-fe455cde4ac4]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjyMNkiu {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LjyMNkiu" returned: 0 in 0.031s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2c11f7-f699-4530-b3b9-9f4005363565]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LjyMNkiu'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda05ee9-9fe9-4ba5-86e7-1f905457b350]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5dab67-2dd1-4ebe-9e7d-17917add9371]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:57:12 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:57:12 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd537d9-6178-452a-87e0-3071e9153292]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767, portal: 172.16.0.220,3260]
Aug 09 22:57:12 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767, portal: 172.16.0.220,3260] successful.
Aug 09 22:57:12 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29ed167-4dfd-4fd2-bed8-013879a0fbef]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0d9dbd-4375-490d-b75b-565ebfb5c9fd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:57:12 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:57:12 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:57:12 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:57:12 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e57fab3-5b2c-4c70-87a4-86519a7ac9b9]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjyMNkiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621832.7493956, 6540903a-e102-40b3-833b-1ec5031c6d82 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:57:12 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] VM Resumed (Lifecycle Event)
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-d8881c86-2d30-4fcf-9b9c-2e69b8866a9e req-12949ba0-4661-4589-8af9-2c2bb418b2df service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d8881c86-2d30-4fcf-9b9c-2e69b8866a9e req-12949ba0-4661-4589-8af9-2c2bb418b2df service nova] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d8881c86-2d30-4fcf-9b9c-2e69b8866a9e req-12949ba0-4661-4589-8af9-2c2bb418b2df service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d8881c86-2d30-4fcf-9b9c-2e69b8866a9e req-12949ba0-4661-4589-8af9-2c2bb418b2df service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-d8881c86-2d30-4fcf-9b9c-2e69b8866a9e req-12949ba0-4661-4589-8af9-2c2bb418b2df service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] No waiting events found dispatching network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:57:12 user nova-compute[72409]: WARNING nova.compute.manager [req-d8881c86-2d30-4fcf-9b9c-2e69b8866a9e req-12949ba0-4661-4589-8af9-2c2bb418b2df service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received unexpected event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 for instance with vm_state building and task_state spawning.
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-d8881c86-2d30-4fcf-9b9c-2e69b8866a9e req-12949ba0-4661-4589-8af9-2c2bb418b2df service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d8881c86-2d30-4fcf-9b9c-2e69b8866a9e req-12949ba0-4661-4589-8af9-2c2bb418b2df service nova] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d8881c86-2d30-4fcf-9b9c-2e69b8866a9e req-12949ba0-4661-4589-8af9-2c2bb418b2df service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d8881c86-2d30-4fcf-9b9c-2e69b8866a9e req-12949ba0-4661-4589-8af9-2c2bb418b2df service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-d8881c86-2d30-4fcf-9b9c-2e69b8866a9e req-12949ba0-4661-4589-8af9-2c2bb418b2df service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] No waiting events found dispatching network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:57:12 user nova-compute[72409]: WARNING nova.compute.manager [req-d8881c86-2d30-4fcf-9b9c-2e69b8866a9e req-12949ba0-4661-4589-8af9-2c2bb418b2df service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received unexpected event network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d for instance with vm_state building and task_state spawning.
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Instance spawned successfully.
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:57:12 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621832.7502615, 6540903a-e102-40b3-833b-1ec5031c6d82 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:57:12 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] VM Started (Lifecycle Event)
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:57:12 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:57:12 user nova-compute[72409]: INFO nova.compute.manager [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 09 22:57:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:13 user nova-compute[72409]: INFO nova.compute.manager [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Took 27.42 seconds to build instance.
Aug 09 22:57:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2aafec1c-c91d-41ad-a316-ae7ae2041e1f tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "6540903a-e102-40b3-833b-1ec5031c6d82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.606s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23762343666366333', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762343666366333', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1875010930',display_name='tempest-TestVolumeBootPattern-server-1875010930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1875010930',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-u9il8uyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:56:51Z,user_data=None,user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=e91a0018-b2f9-4ddf-b082-4b50d815ca54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "address": "fa:16:3e:c3:3d:43", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a9be1b-f3", "ovs_interfaceid": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "address": "fa:16:3e:c3:3d:43", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a9be1b-f3", "ovs_interfaceid": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3d:43,bridge_name='br-int',has_traffic_filtering=True,id=d0a9be1b-f3b7-409a-8b27-d39ad6529435,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a9be1b-f3') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lazy-loading 'pci_devices' on Instance uuid e91a0018-b2f9-4ddf-b082-4b50d815ca54 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:57:13 user nova-compute[72409]:   <uuid>e91a0018-b2f9-4ddf-b082-4b50d815ca54</uuid>
Aug 09 22:57:13 user nova-compute[72409]:   <name>instance-00000016</name>
Aug 09 22:57:13 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:57:13 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:57:13 user nova-compute[72409]:   <metadata>
Aug 09 22:57:13 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:57:13 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:57:13 user nova-compute[72409]:       <nova:name>tempest-TestVolumeBootPattern-server-1875010930</nova:name>
Aug 09 22:57:13 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:57:12</nova:creationTime>
Aug 09 22:57:13 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:57:13 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:57:13 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:57:13 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:57:13 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:57:13 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:57:13 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:57:13 user nova-compute[72409]:       <nova:owner>
Aug 09 22:57:13 user nova-compute[72409]:         <nova:user uuid="bcd5e2f13e0a448e836dd8684b889a70">tempest-TestVolumeBootPattern-431608932-project-member</nova:user>
Aug 09 22:57:13 user nova-compute[72409]:         <nova:project uuid="b6d29522bd16460eb1edc9fb7918111f">tempest-TestVolumeBootPattern-431608932</nova:project>
Aug 09 22:57:13 user nova-compute[72409]:       </nova:owner>
Aug 09 22:57:13 user nova-compute[72409]:       <nova:ports>
Aug 09 22:57:13 user nova-compute[72409]:         <nova:port uuid="d0a9be1b-f3b7-409a-8b27-d39ad6529435">
Aug 09 22:57:13 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 22:57:13 user nova-compute[72409]:         </nova:port>
Aug 09 22:57:13 user nova-compute[72409]:       </nova:ports>
Aug 09 22:57:13 user nova-compute[72409]:     </nova:instance>
Aug 09 22:57:13 user nova-compute[72409]:   </metadata>
Aug 09 22:57:13 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:57:13 user nova-compute[72409]:     <system>
Aug 09 22:57:13 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:57:13 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:57:13 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:57:13 user nova-compute[72409]:       <entry name="serial">e91a0018-b2f9-4ddf-b082-4b50d815ca54</entry>
Aug 09 22:57:13 user nova-compute[72409]:       <entry name="uuid">e91a0018-b2f9-4ddf-b082-4b50d815ca54</entry>
Aug 09 22:57:13 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:57:13 user nova-compute[72409]:     </system>
Aug 09 22:57:13 user nova-compute[72409]:   </sysinfo>
Aug 09 22:57:13 user nova-compute[72409]:   <os>
Aug 09 22:57:13 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:57:13 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:57:13 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:57:13 user nova-compute[72409]:   </os>
Aug 09 22:57:13 user nova-compute[72409]:   <features>
Aug 09 22:57:13 user nova-compute[72409]:     <acpi/>
Aug 09 22:57:13 user nova-compute[72409]:     <apic/>
Aug 09 22:57:13 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:57:13 user nova-compute[72409]:   </features>
Aug 09 22:57:13 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:57:13 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:57:13 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:57:13 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:57:13 user nova-compute[72409]:   </clock>
Aug 09 22:57:13 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:57:13 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:57:13 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:57:13 user nova-compute[72409]:   </cpu>
Aug 09 22:57:13 user nova-compute[72409]:   <devices>
Aug 09 22:57:13 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:57:13 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:57:13 user nova-compute[72409]:       <source dev="/dev/sdc"/>
Aug 09 22:57:13 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:57:13 user nova-compute[72409]:       <serial>48aa5554-7233-4acf-92d3-c7df72698767</serial>
Aug 09 22:57:13 user nova-compute[72409]:     </disk>
Aug 09 22:57:13 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:57:13 user nova-compute[72409]:       <mac address="fa:16:3e:c3:3d:43"/>
Aug 09 22:57:13 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:57:13 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:57:13 user nova-compute[72409]:       <target dev="tapd0a9be1b-f3"/>
Aug 09 22:57:13 user nova-compute[72409]:     </interface>
Aug 09 22:57:13 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:57:13 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/e91a0018-b2f9-4ddf-b082-4b50d815ca54/console.log" append="off"/>
Aug 09 22:57:13 user nova-compute[72409]:     </serial>
Aug 09 22:57:13 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:57:13 user nova-compute[72409]:     <video>
Aug 09 22:57:13 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:57:13 user nova-compute[72409]:     </video>
Aug 09 22:57:13 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:57:13 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:57:13 user nova-compute[72409]:     </rng>
Aug 09 22:57:13 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:57:13 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:57:13 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:57:13 user nova-compute[72409]:     </memballoon>
Aug 09 22:57:13 user nova-compute[72409]:   </devices>
Aug 09 22:57:13 user nova-compute[72409]: </domain>
Aug 09 22:57:13 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1875010930',display_name='tempest-TestVolumeBootPattern-server-1875010930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1875010930',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-u9il8uyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:56:51Z,user_data=None,user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=e91a0018-b2f9-4ddf-b082-4b50d815ca54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "address": "fa:16:3e:c3:3d:43", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a9be1b-f3", "ovs_interfaceid": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "address": "fa:16:3e:c3:3d:43", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a9be1b-f3", "ovs_interfaceid": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3d:43,bridge_name='br-int',has_traffic_filtering=True,id=d0a9be1b-f3b7-409a-8b27-d39ad6529435,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a9be1b-f3') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG os_vif [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3d:43,bridge_name='br-int',has_traffic_filtering=True,id=d0a9be1b-f3b7-409a-8b27-d39ad6529435,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a9be1b-f3') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0a9be1b-f3, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0a9be1b-f3, col_values=(('external_ids', {'iface-id': 'd0a9be1b-f3b7-409a-8b27-d39ad6529435', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:3d:43', 'vm-uuid': 'e91a0018-b2f9-4ddf-b082-4b50d815ca54'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:13 user nova-compute[72409]: INFO os_vif [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3d:43,bridge_name='br-int',has_traffic_filtering=True,id=d0a9be1b-f3b7-409a-8b27-d39ad6529435,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a9be1b-f3')
Aug 09 22:57:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:57:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] No VIF found with MAC fa:16:3e:c3:3d:43, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:57:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-e284f33f-5143-4337-8d36-1c4064cdd21a req-9a68eee8-baa9-4a58-90ed-848175534c38 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e284f33f-5143-4337-8d36-1c4064cdd21a req-9a68eee8-baa9-4a58-90ed-848175534c38 service nova] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e284f33f-5143-4337-8d36-1c4064cdd21a req-9a68eee8-baa9-4a58-90ed-848175534c38 service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e284f33f-5143-4337-8d36-1c4064cdd21a req-9a68eee8-baa9-4a58-90ed-848175534c38 service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-e284f33f-5143-4337-8d36-1c4064cdd21a req-9a68eee8-baa9-4a58-90ed-848175534c38 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] No waiting events found dispatching network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:57:14 user nova-compute[72409]: WARNING nova.compute.manager [req-e284f33f-5143-4337-8d36-1c4064cdd21a req-9a68eee8-baa9-4a58-90ed-848175534c38 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received unexpected event network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d for instance with vm_state building and task_state spawning.
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621835.118396, 65d39a39-3616-40db-906b-d4327e1d63c5 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:57:15 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] VM Resumed (Lifecycle Event)
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:57:15 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Instance spawned successfully.
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:15 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621835.1239588, 65d39a39-3616-40db-906b-d4327e1d63c5 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:57:15 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] VM Started (Lifecycle Event)
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:57:15 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:57:15 user nova-compute[72409]: INFO nova.compute.manager [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Took 8.29 seconds to spawn the instance on the hypervisor.
Aug 09 22:57:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:15 user nova-compute[72409]: INFO nova.compute.manager [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Took 9.20 seconds to build instance.
Aug 09 22:57:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9118e083-4dea-4e5b-9227-0e8a31d0b4fe tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.327s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-8e52cbf0-e2c1-444c-aca4-7cacb6a3066c req-e7ad151f-3edb-4f54-af64-33ebbbfd6b3f service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Received event network-vif-plugged-d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8e52cbf0-e2c1-444c-aca4-7cacb6a3066c req-e7ad151f-3edb-4f54-af64-33ebbbfd6b3f service nova] Acquiring lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8e52cbf0-e2c1-444c-aca4-7cacb6a3066c req-e7ad151f-3edb-4f54-af64-33ebbbfd6b3f service nova] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8e52cbf0-e2c1-444c-aca4-7cacb6a3066c req-e7ad151f-3edb-4f54-af64-33ebbbfd6b3f service nova] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-8e52cbf0-e2c1-444c-aca4-7cacb6a3066c req-e7ad151f-3edb-4f54-af64-33ebbbfd6b3f service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] No waiting events found dispatching network-vif-plugged-d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:57:16 user nova-compute[72409]: WARNING nova.compute.manager [req-8e52cbf0-e2c1-444c-aca4-7cacb6a3066c req-e7ad151f-3edb-4f54-af64-33ebbbfd6b3f service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Received unexpected event network-vif-plugged-d0a9be1b-f3b7-409a-8b27-d39ad6529435 for instance with vm_state building and task_state spawning.
Aug 09 22:57:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621822.6515007, 122c668a-56c6-46b0-9e1f-2f39bdea7418 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:57:17 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] VM Stopped (Lifecycle Event)
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-42449721-4da3-4c2a-9237-fd9df9d24131 None None] [instance: 122c668a-56c6-46b0-9e1f-2f39bdea7418] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621837.8653247, e91a0018-b2f9-4ddf-b082-4b50d815ca54 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:57:17 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] VM Resumed (Lifecycle Event)
Aug 09 22:57:17 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Instance spawned successfully.
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:17 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621837.866046, e91a0018-b2f9-4ddf-b082-4b50d815ca54 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:57:17 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] VM Started (Lifecycle Event)
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:57:18 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:57:18 user nova-compute[72409]: INFO nova.compute.manager [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 09 22:57:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:18 user nova-compute[72409]: INFO nova.compute.manager [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Took 27.65 seconds to build instance.
Aug 09 22:57:18 user nova-compute[72409]: DEBUG nova.compute.manager [req-aaaf304b-808b-4f2e-8134-a560c3bb90b7 req-aff76138-1577-4033-8f06-d0f5f3a4d3e0 service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Received event network-vif-plugged-d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aaaf304b-808b-4f2e-8134-a560c3bb90b7 req-aff76138-1577-4033-8f06-d0f5f3a4d3e0 service nova] Acquiring lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aaaf304b-808b-4f2e-8134-a560c3bb90b7 req-aff76138-1577-4033-8f06-d0f5f3a4d3e0 service nova] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-aaaf304b-808b-4f2e-8134-a560c3bb90b7 req-aff76138-1577-4033-8f06-d0f5f3a4d3e0 service nova] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:18 user nova-compute[72409]: DEBUG nova.compute.manager [req-aaaf304b-808b-4f2e-8134-a560c3bb90b7 req-aff76138-1577-4033-8f06-d0f5f3a4d3e0 service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] No waiting events found dispatching network-vif-plugged-d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:57:18 user nova-compute[72409]: WARNING nova.compute.manager [req-aaaf304b-808b-4f2e-8134-a560c3bb90b7 req-aff76138-1577-4033-8f06-d0f5f3a4d3e0 service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Received unexpected event network-vif-plugged-d0a9be1b-f3b7-409a-8b27-d39ad6529435 for instance with vm_state active and task_state None.
Aug 09 22:57:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e718092-ee46-488d-8e3e-e7b541e4d994 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.805s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Acquiring lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:57:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:57:26 user nova-compute[72409]: INFO nova.compute.claims [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Claim successful on node user
Aug 09 22:57:27 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:57:27 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:57:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG nova.policy [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a6f342aeec444d58f88ae992caae65a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f6b7f15700441388dba7173591367d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:57:27 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Creating image(s)
Aug 09 22:57:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "/opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "/opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk 1073741824" returned: 0 in 0.063s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.189s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Cannot resize image /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG nova.objects.instance [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lazy-loading 'migration_context' on Instance uuid 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Ensure instance console log exists: /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:28 user nova-compute[72409]: DEBUG nova.network.neutron [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Successfully created port: 63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.network.neutron [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Successfully updated port: 63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Acquiring lock "refresh_cache-0c9c767c-ca61-4ed3-b0e9-6e039dd86c78" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Acquired lock "refresh_cache-0c9c767c-ca61-4ed3-b0e9-6e039dd86c78" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.network.neutron [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-e816f289-a526-494f-b56b-758c4dc01beb req-ebadbc41-0cb8-4fa9-a74f-a96e4d31a3cb service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Received event network-changed-63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-e816f289-a526-494f-b56b-758c4dc01beb req-ebadbc41-0cb8-4fa9-a74f-a96e4d31a3cb service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Refreshing instance network info cache due to event network-changed-63866404-07d4-4f53-8a09-095fd6c88dfd. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e816f289-a526-494f-b56b-758c4dc01beb req-ebadbc41-0cb8-4fa9-a74f-a96e4d31a3cb service nova] Acquiring lock "refresh_cache-0c9c767c-ca61-4ed3-b0e9-6e039dd86c78" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.network.neutron [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:57:30 user nova-compute[72409]: INFO nova.compute.claims [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Claim successful on node user
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.network.neutron [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Updating instance_info_cache with network_info: [{"id": "63866404-07d4-4f53-8a09-095fd6c88dfd", "address": "fa:16:3e:4c:95:bd", "network": {"id": "bbd83195-bedb-45fc-9f72-538258cfd53f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1eb3465793574a31b89a7979a72d4df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63866404-07", "ovs_interfaceid": "63866404-07d4-4f53-8a09-095fd6c88dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Releasing lock "refresh_cache-0c9c767c-ca61-4ed3-b0e9-6e039dd86c78" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Instance network_info: |[{"id": "63866404-07d4-4f53-8a09-095fd6c88dfd", "address": "fa:16:3e:4c:95:bd", "network": {"id": "bbd83195-bedb-45fc-9f72-538258cfd53f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1eb3465793574a31b89a7979a72d4df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63866404-07", "ovs_interfaceid": "63866404-07d4-4f53-8a09-095fd6c88dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e816f289-a526-494f-b56b-758c4dc01beb req-ebadbc41-0cb8-4fa9-a74f-a96e4d31a3cb service nova] Acquired lock "refresh_cache-0c9c767c-ca61-4ed3-b0e9-6e039dd86c78" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-e816f289-a526-494f-b56b-758c4dc01beb req-ebadbc41-0cb8-4fa9-a74f-a96e4d31a3cb service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Refreshing network info cache for port 63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Start _get_guest_xml network_info=[{"id": "63866404-07d4-4f53-8a09-095fd6c88dfd", "address": "fa:16:3e:4c:95:bd", "network": {"id": "bbd83195-bedb-45fc-9f72-538258cfd53f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1eb3465793574a31b89a7979a72d4df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63866404-07", "ovs_interfaceid": "63866404-07d4-4f53-8a09-095fd6c88dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:57:30 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:57:30 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-148069530',display_name='tempest-VolumesNegativeTest-instance-148069530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-148069530',id=24,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08f6b7f15700441388dba7173591367d',ramdisk_id='',reservation_id='r-d10lqkag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1680149611',owner_user_name='tempest-VolumesNegativeTest-1680149611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:57:28Z,user_data=None,user_id='3a6f342aeec444d58f88ae992caae65a',uuid=0c9c767c-ca61-4ed3-b0e9-6e039dd86c78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63866404-07d4-4f53-8a09-095fd6c88dfd", "address": "fa:16:3e:4c:95:bd", "network": {"id": "bbd83195-bedb-45fc-9f72-538258cfd53f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1eb3465793574a31b89a7979a72d4df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63866404-07", "ovs_interfaceid": "63866404-07d4-4f53-8a09-095fd6c88dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Converting VIF {"id": "63866404-07d4-4f53-8a09-095fd6c88dfd", "address": "fa:16:3e:4c:95:bd", "network": {"id": "bbd83195-bedb-45fc-9f72-538258cfd53f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1eb3465793574a31b89a7979a72d4df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63866404-07", "ovs_interfaceid": "63866404-07d4-4f53-8a09-095fd6c88dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:95:bd,bridge_name='br-int',has_traffic_filtering=True,id=63866404-07d4-4f53-8a09-095fd6c88dfd,network=Network(bbd83195-bedb-45fc-9f72-538258cfd53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63866404-07') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.objects.instance [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:57:30 user nova-compute[72409]:   <uuid>0c9c767c-ca61-4ed3-b0e9-6e039dd86c78</uuid>
Aug 09 22:57:30 user nova-compute[72409]:   <name>instance-00000018</name>
Aug 09 22:57:30 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:57:30 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:57:30 user nova-compute[72409]:   <metadata>
Aug 09 22:57:30 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:57:30 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:57:30 user nova-compute[72409]:       <nova:name>tempest-VolumesNegativeTest-instance-148069530</nova:name>
Aug 09 22:57:30 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:57:30</nova:creationTime>
Aug 09 22:57:30 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:57:30 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:57:30 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:57:30 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:57:30 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:57:30 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:57:30 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:57:30 user nova-compute[72409]:       <nova:owner>
Aug 09 22:57:30 user nova-compute[72409]:         <nova:user uuid="3a6f342aeec444d58f88ae992caae65a">tempest-VolumesNegativeTest-1680149611-project-member</nova:user>
Aug 09 22:57:30 user nova-compute[72409]:         <nova:project uuid="08f6b7f15700441388dba7173591367d">tempest-VolumesNegativeTest-1680149611</nova:project>
Aug 09 22:57:30 user nova-compute[72409]:       </nova:owner>
Aug 09 22:57:30 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:57:30 user nova-compute[72409]:       <nova:ports>
Aug 09 22:57:30 user nova-compute[72409]:         <nova:port uuid="63866404-07d4-4f53-8a09-095fd6c88dfd">
Aug 09 22:57:30 user nova-compute[72409]:           <nova:ip type="fixed" address="192.168.233.239" ipVersion="4"/>
Aug 09 22:57:30 user nova-compute[72409]:         </nova:port>
Aug 09 22:57:30 user nova-compute[72409]:       </nova:ports>
Aug 09 22:57:30 user nova-compute[72409]:     </nova:instance>
Aug 09 22:57:30 user nova-compute[72409]:   </metadata>
Aug 09 22:57:30 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:57:30 user nova-compute[72409]:     <system>
Aug 09 22:57:30 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:57:30 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:57:30 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:57:30 user nova-compute[72409]:       <entry name="serial">0c9c767c-ca61-4ed3-b0e9-6e039dd86c78</entry>
Aug 09 22:57:30 user nova-compute[72409]:       <entry name="uuid">0c9c767c-ca61-4ed3-b0e9-6e039dd86c78</entry>
Aug 09 22:57:30 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:57:30 user nova-compute[72409]:     </system>
Aug 09 22:57:30 user nova-compute[72409]:   </sysinfo>
Aug 09 22:57:30 user nova-compute[72409]:   <os>
Aug 09 22:57:30 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:57:30 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:57:30 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:57:30 user nova-compute[72409]:   </os>
Aug 09 22:57:30 user nova-compute[72409]:   <features>
Aug 09 22:57:30 user nova-compute[72409]:     <acpi/>
Aug 09 22:57:30 user nova-compute[72409]:     <apic/>
Aug 09 22:57:30 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:57:30 user nova-compute[72409]:   </features>
Aug 09 22:57:30 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:57:30 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:57:30 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:57:30 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:57:30 user nova-compute[72409]:   </clock>
Aug 09 22:57:30 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:57:30 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:57:30 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:57:30 user nova-compute[72409]:   </cpu>
Aug 09 22:57:30 user nova-compute[72409]:   <devices>
Aug 09 22:57:30 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:57:30 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:57:30 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk"/>
Aug 09 22:57:30 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:57:30 user nova-compute[72409]:     </disk>
Aug 09 22:57:30 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:57:30 user nova-compute[72409]:       <mac address="fa:16:3e:4c:95:bd"/>
Aug 09 22:57:30 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:57:30 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:57:30 user nova-compute[72409]:       <target dev="tap63866404-07"/>
Aug 09 22:57:30 user nova-compute[72409]:     </interface>
Aug 09 22:57:30 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:57:30 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/console.log" append="off"/>
Aug 09 22:57:30 user nova-compute[72409]:     </serial>
Aug 09 22:57:30 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:57:30 user nova-compute[72409]:     <video>
Aug 09 22:57:30 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:57:30 user nova-compute[72409]:     </video>
Aug 09 22:57:30 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:57:30 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:57:30 user nova-compute[72409]:     </rng>
Aug 09 22:57:30 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:57:30 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:57:30 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:57:30 user nova-compute[72409]:     </memballoon>
Aug 09 22:57:30 user nova-compute[72409]:   </devices>
Aug 09 22:57:30 user nova-compute[72409]: </domain>
Aug 09 22:57:30 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-148069530',display_name='tempest-VolumesNegativeTest-instance-148069530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-148069530',id=24,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08f6b7f15700441388dba7173591367d',ramdisk_id='',reservation_id='r-d10lqkag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1680149611',owner_user_name='tempest-VolumesNegativeTest-1680149611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:57:28Z,user_data=None,user_id='3a6f342aeec444d58f88ae992caae65a',uuid=0c9c767c-ca61-4ed3-b0e9-6e039dd86c78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63866404-07d4-4f53-8a09-095fd6c88dfd", "address": "fa:16:3e:4c:95:bd", "network": {"id": "bbd83195-bedb-45fc-9f72-538258cfd53f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1eb3465793574a31b89a7979a72d4df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63866404-07", "ovs_interfaceid": "63866404-07d4-4f53-8a09-095fd6c88dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Converting VIF {"id": "63866404-07d4-4f53-8a09-095fd6c88dfd", "address": "fa:16:3e:4c:95:bd", "network": {"id": "bbd83195-bedb-45fc-9f72-538258cfd53f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1eb3465793574a31b89a7979a72d4df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63866404-07", "ovs_interfaceid": "63866404-07d4-4f53-8a09-095fd6c88dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:95:bd,bridge_name='br-int',has_traffic_filtering=True,id=63866404-07d4-4f53-8a09-095fd6c88dfd,network=Network(bbd83195-bedb-45fc-9f72-538258cfd53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63866404-07') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG os_vif [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:95:bd,bridge_name='br-int',has_traffic_filtering=True,id=63866404-07d4-4f53-8a09-095fd6c88dfd,network=Network(bbd83195-bedb-45fc-9f72-538258cfd53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63866404-07') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63866404-07, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63866404-07, col_values=(('external_ids', {'iface-id': '63866404-07d4-4f53-8a09-095fd6c88dfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:95:bd', 'vm-uuid': '0c9c767c-ca61-4ed3-b0e9-6e039dd86c78'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:30 user nova-compute[72409]: INFO os_vif [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:95:bd,bridge_name='br-int',has_traffic_filtering=True,id=63866404-07d4-4f53-8a09-095fd6c88dfd,network=Network(bbd83195-bedb-45fc-9f72-538258cfd53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63866404-07')
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] No VIF found with MAC fa:16:3e:4c:95:bd, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-e816f289-a526-494f-b56b-758c4dc01beb req-ebadbc41-0cb8-4fa9-a74f-a96e4d31a3cb service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Updated VIF entry in instance network info cache for port 63866404-07d4-4f53-8a09-095fd6c88dfd. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-e816f289-a526-494f-b56b-758c4dc01beb req-ebadbc41-0cb8-4fa9-a74f-a96e4d31a3cb service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Updating instance_info_cache with network_info: [{"id": "63866404-07d4-4f53-8a09-095fd6c88dfd", "address": "fa:16:3e:4c:95:bd", "network": {"id": "bbd83195-bedb-45fc-9f72-538258cfd53f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1eb3465793574a31b89a7979a72d4df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63866404-07", "ovs_interfaceid": "63866404-07d4-4f53-8a09-095fd6c88dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e816f289-a526-494f-b56b-758c4dc01beb req-ebadbc41-0cb8-4fa9-a74f-a96e4d31a3cb service nova] Releasing lock "refresh_cache-0c9c767c-ca61-4ed3-b0e9-6e039dd86c78" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:57:30 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:57:31 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:57:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG nova.policy [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce008676a8de41b8b2ffe79ab31462df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894e6764aa794ff29ce4bc213a7def7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:57:31 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Creating image(s)
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "/opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "/opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "/opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.160s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk 1073741824" returned: 0 in 0.079s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.141s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Cannot resize image /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG nova.objects.instance [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'migration_context' on Instance uuid 913c4e3b-f449-45fa-9ca7-3cef4b982679 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Ensure instance console log exists: /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:32 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Successfully created port: a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:57:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-b0ef6558-908a-44e7-9704-75a7d1d466b6 req-72de5a54-850b-469e-8167-edb7905dab43 service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Received event network-vif-plugged-63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b0ef6558-908a-44e7-9704-75a7d1d466b6 req-72de5a54-850b-469e-8167-edb7905dab43 service nova] Acquiring lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b0ef6558-908a-44e7-9704-75a7d1d466b6 req-72de5a54-850b-469e-8167-edb7905dab43 service nova] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b0ef6558-908a-44e7-9704-75a7d1d466b6 req-72de5a54-850b-469e-8167-edb7905dab43 service nova] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-b0ef6558-908a-44e7-9704-75a7d1d466b6 req-72de5a54-850b-469e-8167-edb7905dab43 service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] No waiting events found dispatching network-vif-plugged-63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:57:33 user nova-compute[72409]: WARNING nova.compute.manager [req-b0ef6558-908a-44e7-9704-75a7d1d466b6 req-72de5a54-850b-469e-8167-edb7905dab43 service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Received unexpected event network-vif-plugged-63866404-07d4-4f53-8a09-095fd6c88dfd for instance with vm_state building and task_state spawning.
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Successfully updated port: a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquired lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-7baec413-16d7-4b67-b4ad-32b6f18f8cdd req-c143babc-41d6-47c9-8371-ca25d6b613a3 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-changed-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-7baec413-16d7-4b67-b4ad-32b6f18f8cdd req-c143babc-41d6-47c9-8371-ca25d6b613a3 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Refreshing instance network info cache due to event network-changed-a80bd290-a75e-4702-b917-3319bee30a60. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7baec413-16d7-4b67-b4ad-32b6f18f8cdd req-c143babc-41d6-47c9-8371-ca25d6b613a3 service nova] Acquiring lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updating instance_info_cache with network_info: [{"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Releasing lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Instance network_info: |[{"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7baec413-16d7-4b67-b4ad-32b6f18f8cdd req-c143babc-41d6-47c9-8371-ca25d6b613a3 service nova] Acquired lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.network.neutron [req-7baec413-16d7-4b67-b4ad-32b6f18f8cdd req-c143babc-41d6-47c9-8371-ca25d6b613a3 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Refreshing network info cache for port a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Start _get_guest_xml network_info=[{"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:57:33 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:57:33 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1373843419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1373843419',id=25,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC1hhBxaz7viONyIT9RsHBrWO2Zdg8jzhxEhHD5WrF5eHR/YWIq5aFc8ycg7RekfFI/PdlohcnFbJxcfXXvCNSOh0Z5bDeIh5g1vM6vUGxs6yI1wQi6EYyidFxqU62AkA==',key_name='tempest-keypair-656104974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='894e6764aa794ff29ce4bc213a7def7d',ramdisk_id='',reservation_id='r-0g99dck8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-723310053',owner_user_name='tempest-AttachVolumeShelveTestJSON-723310053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce008676a8de41b8b2ffe79ab31462df',uuid=913c4e3b-f449-45fa-9ca7-3cef4b982679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converting VIF {"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.objects.instance [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'pci_devices' on Instance uuid 913c4e3b-f449-45fa-9ca7-3cef4b982679 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:57:33 user nova-compute[72409]:   <uuid>913c4e3b-f449-45fa-9ca7-3cef4b982679</uuid>
Aug 09 22:57:33 user nova-compute[72409]:   <name>instance-00000019</name>
Aug 09 22:57:33 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:57:33 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:57:33 user nova-compute[72409]:   <metadata>
Aug 09 22:57:33 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:57:33 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:57:33 user nova-compute[72409]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1373843419</nova:name>
Aug 09 22:57:33 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:57:33</nova:creationTime>
Aug 09 22:57:33 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:57:33 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:57:33 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:57:33 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:57:33 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:57:33 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:57:33 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:57:33 user nova-compute[72409]:       <nova:owner>
Aug 09 22:57:33 user nova-compute[72409]:         <nova:user uuid="ce008676a8de41b8b2ffe79ab31462df">tempest-AttachVolumeShelveTestJSON-723310053-project-member</nova:user>
Aug 09 22:57:33 user nova-compute[72409]:         <nova:project uuid="894e6764aa794ff29ce4bc213a7def7d">tempest-AttachVolumeShelveTestJSON-723310053</nova:project>
Aug 09 22:57:33 user nova-compute[72409]:       </nova:owner>
Aug 09 22:57:33 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:57:33 user nova-compute[72409]:       <nova:ports>
Aug 09 22:57:33 user nova-compute[72409]:         <nova:port uuid="a80bd290-a75e-4702-b917-3319bee30a60">
Aug 09 22:57:33 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 22:57:33 user nova-compute[72409]:         </nova:port>
Aug 09 22:57:33 user nova-compute[72409]:       </nova:ports>
Aug 09 22:57:33 user nova-compute[72409]:     </nova:instance>
Aug 09 22:57:33 user nova-compute[72409]:   </metadata>
Aug 09 22:57:33 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:57:33 user nova-compute[72409]:     <system>
Aug 09 22:57:33 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:57:33 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:57:33 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:57:33 user nova-compute[72409]:       <entry name="serial">913c4e3b-f449-45fa-9ca7-3cef4b982679</entry>
Aug 09 22:57:33 user nova-compute[72409]:       <entry name="uuid">913c4e3b-f449-45fa-9ca7-3cef4b982679</entry>
Aug 09 22:57:33 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:57:33 user nova-compute[72409]:     </system>
Aug 09 22:57:33 user nova-compute[72409]:   </sysinfo>
Aug 09 22:57:33 user nova-compute[72409]:   <os>
Aug 09 22:57:33 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:57:33 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:57:33 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:57:33 user nova-compute[72409]:   </os>
Aug 09 22:57:33 user nova-compute[72409]:   <features>
Aug 09 22:57:33 user nova-compute[72409]:     <acpi/>
Aug 09 22:57:33 user nova-compute[72409]:     <apic/>
Aug 09 22:57:33 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:57:33 user nova-compute[72409]:   </features>
Aug 09 22:57:33 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:57:33 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:57:33 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:57:33 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:57:33 user nova-compute[72409]:   </clock>
Aug 09 22:57:33 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:57:33 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:57:33 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:57:33 user nova-compute[72409]:   </cpu>
Aug 09 22:57:33 user nova-compute[72409]:   <devices>
Aug 09 22:57:33 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:57:33 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:57:33 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk"/>
Aug 09 22:57:33 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:57:33 user nova-compute[72409]:     </disk>
Aug 09 22:57:33 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:57:33 user nova-compute[72409]:       <mac address="fa:16:3e:cf:69:56"/>
Aug 09 22:57:33 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:57:33 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:57:33 user nova-compute[72409]:       <target dev="tapa80bd290-a7"/>
Aug 09 22:57:33 user nova-compute[72409]:     </interface>
Aug 09 22:57:33 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:57:33 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/console.log" append="off"/>
Aug 09 22:57:33 user nova-compute[72409]:     </serial>
Aug 09 22:57:33 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:57:33 user nova-compute[72409]:     <video>
Aug 09 22:57:33 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:57:33 user nova-compute[72409]:     </video>
Aug 09 22:57:33 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:57:33 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:57:33 user nova-compute[72409]:     </rng>
Aug 09 22:57:33 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:57:33 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:57:33 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:57:33 user nova-compute[72409]:     </memballoon>
Aug 09 22:57:33 user nova-compute[72409]:   </devices>
Aug 09 22:57:33 user nova-compute[72409]: </domain>
Aug 09 22:57:33 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1373843419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1373843419',id=25,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC1hhBxaz7viONyIT9RsHBrWO2Zdg8jzhxEhHD5WrF5eHR/YWIq5aFc8ycg7RekfFI/PdlohcnFbJxcfXXvCNSOh0Z5bDeIh5g1vM6vUGxs6yI1wQi6EYyidFxqU62AkA==',key_name='tempest-keypair-656104974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='894e6764aa794ff29ce4bc213a7def7d',ramdisk_id='',reservation_id='r-0g99dck8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-723310053',owner_user_name='tempest-AttachVolumeShelveTestJSON-723310053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce008676a8de41b8b2ffe79ab31462df',uuid=913c4e3b-f449-45fa-9ca7-3cef4b982679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converting VIF {"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG os_vif [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa80bd290-a7, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa80bd290-a7, col_values=(('external_ids', {'iface-id': 'a80bd290-a75e-4702-b917-3319bee30a60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:69:56', 'vm-uuid': '913c4e3b-f449-45fa-9ca7-3cef4b982679'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:57:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:33 user nova-compute[72409]: INFO os_vif [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7')
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] No VIF found with MAC fa:16:3e:cf:69:56, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621854.4011762, 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:57:34 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] VM Resumed (Lifecycle Event)
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:57:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Instance spawned successfully.
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:57:34 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621854.4025671, 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:57:34 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] VM Started (Lifecycle Event)
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:57:34 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:57:34 user nova-compute[72409]: INFO nova.compute.manager [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Took 6.84 seconds to spawn the instance on the hypervisor.
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:34 user nova-compute[72409]: INFO nova.compute.manager [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Took 7.96 seconds to build instance.
Aug 09 22:57:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-21dc6505-85ba-4fe8-b1aa-933f0f8b1de3 tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.078s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.network.neutron [req-7baec413-16d7-4b67-b4ad-32b6f18f8cdd req-c143babc-41d6-47c9-8371-ca25d6b613a3 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updated VIF entry in instance network info cache for port a80bd290-a75e-4702-b917-3319bee30a60. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG nova.network.neutron [req-7baec413-16d7-4b67-b4ad-32b6f18f8cdd req-c143babc-41d6-47c9-8371-ca25d6b613a3 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updating instance_info_cache with network_info: [{"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:57:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7baec413-16d7-4b67-b4ad-32b6f18f8cdd req-c143babc-41d6-47c9-8371-ca25d6b613a3 service nova] Releasing lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:57:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-7ba586ba-516b-448d-a0c8-604c932d00d8 req-841b5267-9c19-4223-b61e-349bd956a4cf service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Received event network-vif-plugged-63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7ba586ba-516b-448d-a0c8-604c932d00d8 req-841b5267-9c19-4223-b61e-349bd956a4cf service nova] Acquiring lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7ba586ba-516b-448d-a0c8-604c932d00d8 req-841b5267-9c19-4223-b61e-349bd956a4cf service nova] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7ba586ba-516b-448d-a0c8-604c932d00d8 req-841b5267-9c19-4223-b61e-349bd956a4cf service nova] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-7ba586ba-516b-448d-a0c8-604c932d00d8 req-841b5267-9c19-4223-b61e-349bd956a4cf service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] No waiting events found dispatching network-vif-plugged-63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:57:35 user nova-compute[72409]: WARNING nova.compute.manager [req-7ba586ba-516b-448d-a0c8-604c932d00d8 req-841b5267-9c19-4223-b61e-349bd956a4cf service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Received unexpected event network-vif-plugged-63866404-07d4-4f53-8a09-095fd6c88dfd for instance with vm_state active and task_state None.
Aug 09 22:57:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-2599467d-9f0e-4b0b-8e05-b747742d9faa req-10ce395c-41d6-413a-aef5-c4780f87cc2d service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2599467d-9f0e-4b0b-8e05-b747742d9faa req-10ce395c-41d6-413a-aef5-c4780f87cc2d service nova] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2599467d-9f0e-4b0b-8e05-b747742d9faa req-10ce395c-41d6-413a-aef5-c4780f87cc2d service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2599467d-9f0e-4b0b-8e05-b747742d9faa req-10ce395c-41d6-413a-aef5-c4780f87cc2d service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-2599467d-9f0e-4b0b-8e05-b747742d9faa req-10ce395c-41d6-413a-aef5-c4780f87cc2d service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] No waiting events found dispatching network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:57:36 user nova-compute[72409]: WARNING nova.compute.manager [req-2599467d-9f0e-4b0b-8e05-b747742d9faa req-10ce395c-41d6-413a-aef5-c4780f87cc2d service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received unexpected event network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 for instance with vm_state building and task_state spawning.
Aug 09 22:57:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-87e72762-219d-49dd-ad79-f45bb8f7b0d6 req-822e04ac-0971-4d29-aedb-bea5d7b309ae service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87e72762-219d-49dd-ad79-f45bb8f7b0d6 req-822e04ac-0971-4d29-aedb-bea5d7b309ae service nova] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87e72762-219d-49dd-ad79-f45bb8f7b0d6 req-822e04ac-0971-4d29-aedb-bea5d7b309ae service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87e72762-219d-49dd-ad79-f45bb8f7b0d6 req-822e04ac-0971-4d29-aedb-bea5d7b309ae service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-87e72762-219d-49dd-ad79-f45bb8f7b0d6 req-822e04ac-0971-4d29-aedb-bea5d7b309ae service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] No waiting events found dispatching network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:57:38 user nova-compute[72409]: WARNING nova.compute.manager [req-87e72762-219d-49dd-ad79-f45bb8f7b0d6 req-822e04ac-0971-4d29-aedb-bea5d7b309ae service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received unexpected event network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 for instance with vm_state building and task_state spawning.
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621858.29648, 913c4e3b-f449-45fa-9ca7-3cef4b982679 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:57:38 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] VM Resumed (Lifecycle Event)
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:57:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Instance spawned successfully.
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:57:38 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621858.300345, 913c4e3b-f449-45fa-9ca7-3cef4b982679 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:57:38 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] VM Started (Lifecycle Event)
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:57:38 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:57:38 user nova-compute[72409]: INFO nova.compute.manager [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Took 7.33 seconds to spawn the instance on the hypervisor.
Aug 09 22:57:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:57:38 user nova-compute[72409]: INFO nova.compute.manager [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Took 8.25 seconds to build instance.
Aug 09 22:57:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c3c4b45-6e84-4cf1-ab56-347506726fb4 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.367s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:48 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:57:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:49 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:57:50 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:57:50 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:57:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:57:52 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:57:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:57:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:57:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:57:54 user nova-compute[72409]: INFO nova.compute.claims [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Claim successful on node user
Aug 09 22:57:54 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG nova.network.neutron [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:57:54 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:57:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG nova.policy [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fa331e6178145b5b9a0d07a4b4a4d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa953a0836e54254a4917555ccf838a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:57:54 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Creating image(s)
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "/opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "/opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk 1073741824" returned: 0 in 0.096s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.201s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Successfully created port: fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Cannot resize image /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG nova.objects.instance [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lazy-loading 'migration_context' on Instance uuid 3b3ff97a-c2d6-4a63-8150-cc22f5903fae {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Ensure instance console log exists: /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG nova.network.neutron [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Successfully updated port: fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "refresh_cache-3b3ff97a-c2d6-4a63-8150-cc22f5903fae" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquired lock "refresh_cache-3b3ff97a-c2d6-4a63-8150-cc22f5903fae" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG nova.network.neutron [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-6467a117-3676-400e-bf86-0cc4cb2fe05b req-d5a48d25-8abe-45a2-b126-4a4da317b977 service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Received event network-changed-fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-6467a117-3676-400e-bf86-0cc4cb2fe05b req-d5a48d25-8abe-45a2-b126-4a4da317b977 service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Refreshing instance network info cache due to event network-changed-fc78fed8-8a1c-4619-90bd-46307b9dd406. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6467a117-3676-400e-bf86-0cc4cb2fe05b req-d5a48d25-8abe-45a2-b126-4a4da317b977 service nova] Acquiring lock "refresh_cache-3b3ff97a-c2d6-4a63-8150-cc22f5903fae" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG nova.network.neutron [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:56 user nova-compute[72409]: DEBUG nova.network.neutron [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Updating instance_info_cache with network_info: [{"id": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "address": "fa:16:3e:ff:04:f3", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78fed8-8a", "ovs_interfaceid": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Releasing lock "refresh_cache-3b3ff97a-c2d6-4a63-8150-cc22f5903fae" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Instance network_info: |[{"id": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "address": "fa:16:3e:ff:04:f3", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78fed8-8a", "ovs_interfaceid": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6467a117-3676-400e-bf86-0cc4cb2fe05b req-d5a48d25-8abe-45a2-b126-4a4da317b977 service nova] Acquired lock "refresh_cache-3b3ff97a-c2d6-4a63-8150-cc22f5903fae" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.network.neutron [req-6467a117-3676-400e-bf86-0cc4cb2fe05b req-d5a48d25-8abe-45a2-b126-4a4da317b977 service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Refreshing network info cache for port fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Start _get_guest_xml network_info=[{"id": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "address": "fa:16:3e:ff:04:f3", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78fed8-8a", "ovs_interfaceid": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:57:57 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:57:57 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1626907645',display_name='tempest-VolumesActionsTest-instance-1626907645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1626907645',id=26,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa953a0836e54254a4917555ccf838a1',ramdisk_id='',reservation_id='r-mp0u5vo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-24018393',owner_user_name='tempest-VolumesActionsTest-24018393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:57:55Z,user_data=None,user_id='8fa331e6178145b5b9a0d07a4b4a4d63',uuid=3b3ff97a-c2d6-4a63-8150-cc22f5903fae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "address": "fa:16:3e:ff:04:f3", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78fed8-8a", "ovs_interfaceid": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Converting VIF {"id": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "address": "fa:16:3e:ff:04:f3", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78fed8-8a", "ovs_interfaceid": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:f3,bridge_name='br-int',has_traffic_filtering=True,id=fc78fed8-8a1c-4619-90bd-46307b9dd406,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78fed8-8a') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.objects.instance [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b3ff97a-c2d6-4a63-8150-cc22f5903fae {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:57:57 user nova-compute[72409]:   <uuid>3b3ff97a-c2d6-4a63-8150-cc22f5903fae</uuid>
Aug 09 22:57:57 user nova-compute[72409]:   <name>instance-0000001a</name>
Aug 09 22:57:57 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:57:57 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:57:57 user nova-compute[72409]:   <metadata>
Aug 09 22:57:57 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:57:57 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:57:57 user nova-compute[72409]:       <nova:name>tempest-VolumesActionsTest-instance-1626907645</nova:name>
Aug 09 22:57:57 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:57:57</nova:creationTime>
Aug 09 22:57:57 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:57:57 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:57:57 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:57:57 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:57:57 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:57:57 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:57:57 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:57:57 user nova-compute[72409]:       <nova:owner>
Aug 09 22:57:57 user nova-compute[72409]:         <nova:user uuid="8fa331e6178145b5b9a0d07a4b4a4d63">tempest-VolumesActionsTest-24018393-project-member</nova:user>
Aug 09 22:57:57 user nova-compute[72409]:         <nova:project uuid="aa953a0836e54254a4917555ccf838a1">tempest-VolumesActionsTest-24018393</nova:project>
Aug 09 22:57:57 user nova-compute[72409]:       </nova:owner>
Aug 09 22:57:57 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:57:57 user nova-compute[72409]:       <nova:ports>
Aug 09 22:57:57 user nova-compute[72409]:         <nova:port uuid="fc78fed8-8a1c-4619-90bd-46307b9dd406">
Aug 09 22:57:57 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 22:57:57 user nova-compute[72409]:         </nova:port>
Aug 09 22:57:57 user nova-compute[72409]:       </nova:ports>
Aug 09 22:57:57 user nova-compute[72409]:     </nova:instance>
Aug 09 22:57:57 user nova-compute[72409]:   </metadata>
Aug 09 22:57:57 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:57:57 user nova-compute[72409]:     <system>
Aug 09 22:57:57 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:57:57 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:57:57 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:57:57 user nova-compute[72409]:       <entry name="serial">3b3ff97a-c2d6-4a63-8150-cc22f5903fae</entry>
Aug 09 22:57:57 user nova-compute[72409]:       <entry name="uuid">3b3ff97a-c2d6-4a63-8150-cc22f5903fae</entry>
Aug 09 22:57:57 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:57:57 user nova-compute[72409]:     </system>
Aug 09 22:57:57 user nova-compute[72409]:   </sysinfo>
Aug 09 22:57:57 user nova-compute[72409]:   <os>
Aug 09 22:57:57 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:57:57 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:57:57 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:57:57 user nova-compute[72409]:   </os>
Aug 09 22:57:57 user nova-compute[72409]:   <features>
Aug 09 22:57:57 user nova-compute[72409]:     <acpi/>
Aug 09 22:57:57 user nova-compute[72409]:     <apic/>
Aug 09 22:57:57 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:57:57 user nova-compute[72409]:   </features>
Aug 09 22:57:57 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:57:57 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:57:57 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:57:57 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:57:57 user nova-compute[72409]:   </clock>
Aug 09 22:57:57 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:57:57 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:57:57 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:57:57 user nova-compute[72409]:   </cpu>
Aug 09 22:57:57 user nova-compute[72409]:   <devices>
Aug 09 22:57:57 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:57:57 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:57:57 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk"/>
Aug 09 22:57:57 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:57:57 user nova-compute[72409]:     </disk>
Aug 09 22:57:57 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:57:57 user nova-compute[72409]:       <mac address="fa:16:3e:ff:04:f3"/>
Aug 09 22:57:57 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:57:57 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:57:57 user nova-compute[72409]:       <target dev="tapfc78fed8-8a"/>
Aug 09 22:57:57 user nova-compute[72409]:     </interface>
Aug 09 22:57:57 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:57:57 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/console.log" append="off"/>
Aug 09 22:57:57 user nova-compute[72409]:     </serial>
Aug 09 22:57:57 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:57:57 user nova-compute[72409]:     <video>
Aug 09 22:57:57 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:57:57 user nova-compute[72409]:     </video>
Aug 09 22:57:57 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:57:57 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:57:57 user nova-compute[72409]:     </rng>
Aug 09 22:57:57 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:57:57 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:57:57 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:57:57 user nova-compute[72409]:     </memballoon>
Aug 09 22:57:57 user nova-compute[72409]:   </devices>
Aug 09 22:57:57 user nova-compute[72409]: </domain>
Aug 09 22:57:57 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1626907645',display_name='tempest-VolumesActionsTest-instance-1626907645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1626907645',id=26,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa953a0836e54254a4917555ccf838a1',ramdisk_id='',reservation_id='r-mp0u5vo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-24018393',owner_user_name='tempest-VolumesActionsTest-24018393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:57:55Z,user_data=None,user_id='8fa331e6178145b5b9a0d07a4b4a4d63',uuid=3b3ff97a-c2d6-4a63-8150-cc22f5903fae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "address": "fa:16:3e:ff:04:f3", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78fed8-8a", "ovs_interfaceid": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Converting VIF {"id": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "address": "fa:16:3e:ff:04:f3", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78fed8-8a", "ovs_interfaceid": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:f3,bridge_name='br-int',has_traffic_filtering=True,id=fc78fed8-8a1c-4619-90bd-46307b9dd406,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78fed8-8a') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG os_vif [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:f3,bridge_name='br-int',has_traffic_filtering=True,id=fc78fed8-8a1c-4619-90bd-46307b9dd406,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78fed8-8a') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc78fed8-8a, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc78fed8-8a, col_values=(('external_ids', {'iface-id': 'fc78fed8-8a1c-4619-90bd-46307b9dd406', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:04:f3', 'vm-uuid': '3b3ff97a-c2d6-4a63-8150-cc22f5903fae'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:57:57 user nova-compute[72409]: INFO os_vif [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:f3,bridge_name='br-int',has_traffic_filtering=True,id=fc78fed8-8a1c-4619-90bd-46307b9dd406,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78fed8-8a')
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] No VIF found with MAC fa:16:3e:ff:04:f3, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.network.neutron [req-6467a117-3676-400e-bf86-0cc4cb2fe05b req-d5a48d25-8abe-45a2-b126-4a4da317b977 service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Updated VIF entry in instance network info cache for port fc78fed8-8a1c-4619-90bd-46307b9dd406. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG nova.network.neutron [req-6467a117-3676-400e-bf86-0cc4cb2fe05b req-d5a48d25-8abe-45a2-b126-4a4da317b977 service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Updating instance_info_cache with network_info: [{"id": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "address": "fa:16:3e:ff:04:f3", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78fed8-8a", "ovs_interfaceid": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6467a117-3676-400e-bf86-0cc4cb2fe05b req-d5a48d25-8abe-45a2-b126-4a4da317b977 service nova] Releasing lock "refresh_cache-3b3ff97a-c2d6-4a63-8150-cc22f5903fae" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:57:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:57:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621881.108505, 3b3ff97a-c2d6-4a63-8150-cc22f5903fae => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:58:01 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] VM Resumed (Lifecycle Event)
Aug 09 22:58:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-003205a6-8eed-48cb-8faf-0db0a179dd19 req-4cea1320-3610-46ec-bbb0-259fbf946487 service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Received event network-vif-plugged-fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-003205a6-8eed-48cb-8faf-0db0a179dd19 req-4cea1320-3610-46ec-bbb0-259fbf946487 service nova] Acquiring lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-003205a6-8eed-48cb-8faf-0db0a179dd19 req-4cea1320-3610-46ec-bbb0-259fbf946487 service nova] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-003205a6-8eed-48cb-8faf-0db0a179dd19 req-4cea1320-3610-46ec-bbb0-259fbf946487 service nova] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-003205a6-8eed-48cb-8faf-0db0a179dd19 req-4cea1320-3610-46ec-bbb0-259fbf946487 service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] No waiting events found dispatching network-vif-plugged-fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:01 user nova-compute[72409]: WARNING nova.compute.manager [req-003205a6-8eed-48cb-8faf-0db0a179dd19 req-4cea1320-3610-46ec-bbb0-259fbf946487 service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Received unexpected event network-vif-plugged-fc78fed8-8a1c-4619-90bd-46307b9dd406 for instance with vm_state building and task_state spawning.
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-000a650d-5168-4820-9acc-70fcbfd16a67 req-f53c317a-6240-4f36-9bee-4d885d481c83 service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Received event network-vif-plugged-fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-000a650d-5168-4820-9acc-70fcbfd16a67 req-f53c317a-6240-4f36-9bee-4d885d481c83 service nova] Acquiring lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-000a650d-5168-4820-9acc-70fcbfd16a67 req-f53c317a-6240-4f36-9bee-4d885d481c83 service nova] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-000a650d-5168-4820-9acc-70fcbfd16a67 req-f53c317a-6240-4f36-9bee-4d885d481c83 service nova] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-000a650d-5168-4820-9acc-70fcbfd16a67 req-f53c317a-6240-4f36-9bee-4d885d481c83 service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] No waiting events found dispatching network-vif-plugged-fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:01 user nova-compute[72409]: WARNING nova.compute.manager [req-000a650d-5168-4820-9acc-70fcbfd16a67 req-f53c317a-6240-4f36-9bee-4d885d481c83 service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Received unexpected event network-vif-plugged-fc78fed8-8a1c-4619-90bd-46307b9dd406 for instance with vm_state building and task_state spawning.
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "3f216945-199d-4047-8bc8-407d5842c536" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:01 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Instance spawned successfully.
Aug 09 22:58:01 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:58:01 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=6989MB free_disk=25.41280746459961GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'flavor' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:58:01 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621881.1087372, 3b3ff97a-c2d6-4a63-8150-cc22f5903fae => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:58:01 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] VM Started (Lifecycle Event)
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "3f216945-199d-4047-8bc8-407d5842c536" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:58:01 user nova-compute[72409]: INFO nova.compute.manager [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Took 6.99 seconds to spawn the instance on the hypervisor.
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:01 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5b7906a3-e02b-49a3-9a56-fc34a8730238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c17c9b77-8e04-432c-9634-c4bee2eb8889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c513e397-28f7-4d93-8487-257becbef9d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 451ed986-57e6-485e-90b1-231c5ea3db20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 6540903a-e102-40b3-833b-1ec5031c6d82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance e91a0018-b2f9-4ddf-b082-4b50d815ca54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 65d39a39-3616-40db-906b-d4327e1d63c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 913c4e3b-f449-45fa-9ca7-3cef4b982679 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3b3ff97a-c2d6-4a63-8150-cc22f5903fae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:58:01 user nova-compute[72409]: INFO nova.compute.manager [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Took 7.85 seconds to build instance.
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7b9edc21-baf6-498f-901c-56b9fe680f78 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.958s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "3f216945-199d-4047-8bc8-407d5842c536" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:01 user nova-compute[72409]: INFO nova.compute.manager [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Attaching volume b3dd997e-509b-4f16-813a-70e82d2d3168 to /dev/vdb
Aug 09 22:58:02 user nova-compute[72409]: DEBUG os_brick.utils [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f16442d-fa55-44be-a481-6fe50accfbf3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bca6d80-9e2b-49ae-b6e6-89aa202d9a4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4a3c07-8d4c-4510-9ba0-8ee7163eed37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31e677f-e792-4528-9aed-c8bdbdf3bbfe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:58:02 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99bcf60-3745-4800-989f-cbd74f58a2b6]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG os_brick.utils [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updating existing volume attachment record: c70f9d84-ff6a-4384-b97a-455fdcfeb513 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:58:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.797s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:03 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:58:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:58:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:58:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:58:03 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 22:58:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updating instance_info_cache with network_info: [{"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:58:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:58:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 22:58:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:58:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bovJOXEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:58:11 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:58:11 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:58:11 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa48e0c-ce45-4cb7-b7f8-b35d52c25382]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:58:11 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f80f6a-b97a-40fc-8a4b-abaf79747d4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168] added
Aug 09 22:58:11 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1176228f-2e9e-4d19-907a-c5b34c5877b3]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36bd0b4-cda3-4f79-b96e-b581590d008e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bovJOXEK {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bovJOXEK" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b7c8df-0545-4325-bd1e-2c6ab69b173e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bovJOXEK'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c7016-21d9-431d-88fc-d7a7acd6c8a4]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4019a431-8edc-43bb-b6a6-e737174c7bfd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:11 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:11 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:11 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:11 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a3cbc8-c532-44d8-aab3-8f7dbb43ce0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260]
Aug 09 22:58:11 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260] successful.
Aug 09 22:58:11 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1561ef4-4e8e-42e3-a953-fb90f4ff6a68]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfba47d0-ad9a-4f1e-8316-d07903ea1519]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:11 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:11 user nova-compute[72409]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:58:11 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:11 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:11 user nova-compute[72409]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:58:11 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c6029b-4e25-482e-98b1-a565cfccfa2b]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:58:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bovJOXEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:58:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:58:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23762363331363531', 'path': '/dev/sdd'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:58:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762363331363531', 'path': '/dev/sdd'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:58:12 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'flavor' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 22:58:12 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:58:12 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 22:58:12 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:58:12 user nova-compute[72409]:   <serial>b3dd997e-509b-4f16-813a-70e82d2d3168</serial>
Aug 09 22:58:12 user nova-compute[72409]: </disk>
Aug 09 22:58:12 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 22:58:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:58:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:58:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] No VIF found with MAC fa:16:3e:a7:ea:25, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:58:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b382e6be-4165-4b99-b053-afa4253f49e1 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "3f216945-199d-4047-8bc8-407d5842c536" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.440s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:14 user nova-compute[72409]: INFO nova.compute.manager [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Rebuilding instance
Aug 09 22:58:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:14 user nova-compute[72409]: DEBUG nova.compute.manager [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'pci_requests' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'resources' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'migration_context' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72409) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 22:58:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-5a934aba-d093-4fab-ac1e-f4f9c34855fb req-9d873ffe-c7f6-411e-8fe7-57fe1e9d504a service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-vif-unplugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5a934aba-d093-4fab-ac1e-f4f9c34855fb req-9d873ffe-c7f6-411e-8fe7-57fe1e9d504a service nova] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5a934aba-d093-4fab-ac1e-f4f9c34855fb req-9d873ffe-c7f6-411e-8fe7-57fe1e9d504a service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5a934aba-d093-4fab-ac1e-f4f9c34855fb req-9d873ffe-c7f6-411e-8fe7-57fe1e9d504a service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-5a934aba-d093-4fab-ac1e-f4f9c34855fb req-9d873ffe-c7f6-411e-8fe7-57fe1e9d504a service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] No waiting events found dispatching network-vif-unplugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:15 user nova-compute[72409]: WARNING nova.compute.manager [req-5a934aba-d093-4fab-ac1e-f4f9c34855fb req-9d873ffe-c7f6-411e-8fe7-57fe1e9d504a service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received unexpected event network-vif-unplugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a for instance with vm_state active and task_state rebuilding.
Aug 09 22:58:15 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Instance destroyed successfully.
Aug 09 22:58:15 user nova-compute[72409]: INFO nova.compute.manager [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Detaching volume b3dd997e-509b-4f16-813a-70e82d2d3168
Aug 09 22:58:15 user nova-compute[72409]: INFO nova.virt.block_device [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Attempting to driver detach volume b3dd997e-509b-4f16-813a-70e82d2d3168 from mountpoint /dev/vdb
Aug 09 22:58:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Attempting to detach device vdb from instance 3f216945-199d-4047-8bc8-407d5842c536 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 22:58:15 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:58:15 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 22:58:15 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:58:15 user nova-compute[72409]:   <serial>b3dd997e-509b-4f16-813a-70e82d2d3168</serial>
Aug 09 22:58:15 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 22:58:15 user nova-compute[72409]: </disk>
Aug 09 22:58:15 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 22:58:15 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Successfully detached device vdb from instance 3f216945-199d-4047-8bc8-407d5842c536 from the persistent domain config.
Aug 09 22:58:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bovJOXEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:58:15 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 22:58:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f814c4c1-705e-4640-ad84-9f17eb730007]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e70953-a37d-4013-bb94-b474c60e80ff]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:15 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:15 user nova-compute[72409]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:58:15 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:15 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:15 user nova-compute[72409]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:58:15 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e9c3ae3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168'): ({'sdd'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Removing single pathed devices sdd {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a27d366-7c32-4f09-b138-bf4c0c56ea3e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b54402-fdbf-4b5d-be22-8d5f18f4a3d9]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Flushing IO for device /dev/sdd {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6697f0-fa68-45ba-90fa-8980d1dc3b87]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.117s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f7cef-342e-46b3-b459-e2b9960be263]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23eb51b-7859-425a-bd5e-03cc58bb2d70]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1471859-c3f8-4f5d-a833-ceaec17e683c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260]
Aug 09 22:58:16 user nova-compute[72409]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260] successful.
Aug 09 22:58:16 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[646aec07-c574-41c4-9d7f-832132a304d0]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== disconnect_volume: return (363ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:58:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:17 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Instance destroyed successfully.
Aug 09 22:58:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-869366492',display_name='tempest-ServerActionsTestOtherA-server-1401261704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-869366492',id=16,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzHC0syLklL8GtXvz6DwLHZAI3KijCzzG+c3H7vbfCfvBbdLu31zQrL5KQv6qO6LPapTOC2Zi0KeYbsTlIE+6d9oW1MPV8oBMrDCQEY9sL1aQ71vDiQHBGpACA1bJ0plQ==',key_name='tempest-keypair-183406528',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c7e3f592e7141659581ae7f67c6af43',ramdisk_id='',reservation_id='r-sst2ny3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-640999933',owner_user_name='tempest-ServerActionsTestOtherA-640999933-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd76f1c0d9b42269fcc69f24c9f59e6',uuid=3f216945-199d-4047-8bc8-407d5842c536,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converting VIF {"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_vif [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap410a93bc-9f, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:17 user nova-compute[72409]: INFO os_vif [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f')
Aug 09 22:58:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bovJOXEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:58:17 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4203e86-f4d5-4446-9114-9f88ac5107d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-c2e9f268-5ae1-4dad-bda2-dc415bf9751d req-d02fa646-b4f0-4312-8d20-01d7d56a3d51 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c2e9f268-5ae1-4dad-bda2-dc415bf9751d req-d02fa646-b4f0-4312-8d20-01d7d56a3d51 service nova] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c2e9f268-5ae1-4dad-bda2-dc415bf9751d req-d02fa646-b4f0-4312-8d20-01d7d56a3d51 service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c2e9f268-5ae1-4dad-bda2-dc415bf9751d req-d02fa646-b4f0-4312-8d20-01d7d56a3d51 service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-c2e9f268-5ae1-4dad-bda2-dc415bf9751d req-d02fa646-b4f0-4312-8d20-01d7d56a3d51 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] No waiting events found dispatching network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:17 user nova-compute[72409]: WARNING nova.compute.manager [req-c2e9f268-5ae1-4dad-bda2-dc415bf9751d req-d02fa646-b4f0-4312-8d20-01d7d56a3d51 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received unexpected event network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a for instance with vm_state active and task_state rebuilding.
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6461cba-f174-486b-b031-bb7d405f31a5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:17 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:17 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:17 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:17 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e845c9480>, {}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Disconnecting from: [] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== disconnect_volume: return (51ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:58:17 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Deleting instance files /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536_del
Aug 09 22:58:17 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Deletion of /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536_del complete
Aug 09 22:58:17 user nova-compute[72409]: INFO nova.virt.block_device [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Booting with volume b3dd997e-509b-4f16-813a-70e82d2d3168 at /dev/vdb
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.utils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2535dca3-fd70-40fb-9fd4-fddab1c012dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e076293-33ab-4cc8-ad26-ffde6d30f07a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6740fe9c-e02d-440e-9577-1ff8b079cb6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7fcf2a-c0f8-44d5-acce-898402092768]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:58:17 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:58:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2885b1da-ebe9-4121-b48f-83d594f4d0ed]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG os_brick.utils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:58:17 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updating existing volume attachment record: fe31b8aa-d376-434f-a63c-76e4676aceb2 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:58:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "451ed986-57e6-485e-90b1-231c5ea3db20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "451ed986-57e6-485e-90b1-231c5ea3db20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:25 user nova-compute[72409]: INFO nova.compute.manager [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Terminating instance
Aug 09 22:58:25 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-540ab01d-3ce2-4d70-9bb9-54f720699715 req-90bdd93a-2500-4b70-807a-7ce10e6af743 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Received event network-vif-unplugged-9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-540ab01d-3ce2-4d70-9bb9-54f720699715 req-90bdd93a-2500-4b70-807a-7ce10e6af743 service nova] Acquiring lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-540ab01d-3ce2-4d70-9bb9-54f720699715 req-90bdd93a-2500-4b70-807a-7ce10e6af743 service nova] Lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-540ab01d-3ce2-4d70-9bb9-54f720699715 req-90bdd93a-2500-4b70-807a-7ce10e6af743 service nova] Lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-540ab01d-3ce2-4d70-9bb9-54f720699715 req-90bdd93a-2500-4b70-807a-7ce10e6af743 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] No waiting events found dispatching network-vif-unplugged-9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-540ab01d-3ce2-4d70-9bb9-54f720699715 req-90bdd93a-2500-4b70-807a-7ce10e6af743 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Received event network-vif-unplugged-9befc7d9-aae4-419f-953b-77e098e43523 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Instance destroyed successfully.
Aug 09 22:58:26 user nova-compute[72409]: DEBUG nova.objects.instance [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lazy-loading 'resources' on Instance uuid 451ed986-57e6-485e-90b1-231c5ea3db20 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1026833379',display_name='tempest-ServersNegativeTestJSON-server-1026833379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1026833379',id=20,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37caf02dd0db418cbbdcd1d13349bd53',ramdisk_id='',reservation_id='r-8n6f5jdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-648629170',owner_user_name='tempest-ServersNegativeTestJSON-648629170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:56:43Z,user_data=None,user_id='28bd09bfc6304cb398964bbe964878bf',uuid=451ed986-57e6-485e-90b1-231c5ea3db20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9befc7d9-aae4-419f-953b-77e098e43523", "address": "fa:16:3e:8c:e0:b9", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9befc7d9-aa", "ovs_interfaceid": "9befc7d9-aae4-419f-953b-77e098e43523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Converting VIF {"id": "9befc7d9-aae4-419f-953b-77e098e43523", "address": "fa:16:3e:8c:e0:b9", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9befc7d9-aa", "ovs_interfaceid": "9befc7d9-aae4-419f-953b-77e098e43523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e0:b9,bridge_name='br-int',has_traffic_filtering=True,id=9befc7d9-aae4-419f-953b-77e098e43523,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9befc7d9-aa') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG os_vif [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e0:b9,bridge_name='br-int',has_traffic_filtering=True,id=9befc7d9-aae4-419f-953b-77e098e43523,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9befc7d9-aa') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9befc7d9-aa, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:58:26 user nova-compute[72409]: INFO os_vif [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e0:b9,bridge_name='br-int',has_traffic_filtering=True,id=9befc7d9-aae4-419f-953b-77e098e43523,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9befc7d9-aa')
Aug 09 22:58:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Deleting instance files /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20_del
Aug 09 22:58:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Deletion of /opt/stack/data/nova/instances/451ed986-57e6-485e-90b1-231c5ea3db20_del complete
Aug 09 22:58:26 user nova-compute[72409]: INFO nova.compute.manager [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 22:58:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Creating image(s)
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "/opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "/opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG nova.compute.manager [req-86c4a3ea-e1b8-49f7-a7a2-b097a9d80317 req-2af61af5-1940-4b22-8c21-3401f33541af service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Received event network-vif-deleted-9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:26 user nova-compute[72409]: INFO nova.compute.manager [req-86c4a3ea-e1b8-49f7-a7a2-b097a9d80317 req-2af61af5-1940-4b22-8c21-3401f33541af service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Neutron deleted interface 9befc7d9-aae4-419f-953b-77e098e43523; detaching it from the instance and deleting it from the info cache
Aug 09 22:58:26 user nova-compute[72409]: DEBUG nova.network.neutron [req-86c4a3ea-e1b8-49f7-a7a2-b097a9d80317 req-2af61af5-1940-4b22-8c21-3401f33541af service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:58:26 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Took 0.54 seconds to deallocate network for instance.
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.174s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG nova.compute.manager [req-86c4a3ea-e1b8-49f7-a7a2-b097a9d80317 req-2af61af5-1940-4b22-8c21-3401f33541af service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Detach interface failed, port_id=9befc7d9-aae4-419f-953b-77e098e43523, reason: Instance 451ed986-57e6-485e-90b1-231c5ea3db20 could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk 1073741824" returned: 0 in 0.052s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.158s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Cannot resize image /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Ensure instance console log exists: /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Start _get_guest_xml network_info=[{"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bovJOXEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3f216945-199d-4047-8bc8-407d5842c536', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3dd997e-509b-4f16-813a-70e82d2d3168', 'serial': 'b3dd997e-509b-4f16-813a-70e82d2d3168'}, 'mount_device': '/dev/vdb', 'attachment_id': 'fe31b8aa-d376-434f-a63c-76e4676aceb2', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:58:27 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 22:58:27 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.objects.instance [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bovJOXEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:58:27 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:58:27 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:58:27 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:58:27 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Deleted allocations for instance 451ed986-57e6-485e-90b1-231c5ea3db20
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a13f07-52ef-4557-891b-c6ef3f1988c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:58:27 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13a4ad3-8351-4521-9e0d-56cb3d233d5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168] added
Aug 09 22:58:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[be318016-fca5-40a6-b4f1-687385138deb]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ce9a2a7a-904e-457d-8bd4-aea6bf986ddc tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "451ed986-57e6-485e-90b1-231c5ea3db20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.016s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a90834f-78b8-4f81-ae75-64959c512166]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bovJOXEK {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bovJOXEK" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c475f5-27b8-48bd-95cd-875fa73dd0e4]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bovJOXEK'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08b87ff-3f7d-40e3-ac15-e5add72946f4]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[113355cf-e634-46dd-9513-1c38452b8289]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:27 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:27 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[567fa977-9c6b-4ca3-9c8c-a5e511bd871b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260]
Aug 09 22:58:27 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260] successful.
Aug 09 22:58:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56fd13b-7a9b-4d31-a7de-682159e7a5a5]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf119ac-a660-4a61-a8d7-4e319568e6b4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:27 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:27 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:58:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:27 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:27 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:58:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a23d98c-004e-4d4f-9d3e-a1c5765ef9a7]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bovJOXEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-46d4ca9d-4f55-4905-9037-ed09c9255157 req-6835fdd4-2685-4093-a34b-e2aa7f6dd793 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Received event network-vif-plugged-9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-46d4ca9d-4f55-4905-9037-ed09c9255157 req-6835fdd4-2685-4093-a34b-e2aa7f6dd793 service nova] Acquiring lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-46d4ca9d-4f55-4905-9037-ed09c9255157 req-6835fdd4-2685-4093-a34b-e2aa7f6dd793 service nova] Lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-46d4ca9d-4f55-4905-9037-ed09c9255157 req-6835fdd4-2685-4093-a34b-e2aa7f6dd793 service nova] Lock "451ed986-57e6-485e-90b1-231c5ea3db20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-46d4ca9d-4f55-4905-9037-ed09c9255157 req-6835fdd4-2685-4093-a34b-e2aa7f6dd793 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] No waiting events found dispatching network-vif-plugged-9befc7d9-aae4-419f-953b-77e098e43523 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:27 user nova-compute[72409]: WARNING nova.compute.manager [req-46d4ca9d-4f55-4905-9037-ed09c9255157 req-6835fdd4-2685-4093-a34b-e2aa7f6dd793 service nova] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Received unexpected event network-vif-plugged-9befc7d9-aae4-419f-953b-77e098e43523 for instance with vm_state deleted and task_state None.
Aug 09 22:58:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23762363331363531', 'path': '/dev/sdd'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762363331363531', 'path': '/dev/sdd'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T22:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-869366492',display_name='tempest-ServerActionsTestOtherA-server-1401261704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-869366492',id=16,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzHC0syLklL8GtXvz6DwLHZAI3KijCzzG+c3H7vbfCfvBbdLu31zQrL5KQv6qO6LPapTOC2Zi0KeYbsTlIE+6d9oW1MPV8oBMrDCQEY9sL1aQ71vDiQHBGpACA1bJ0plQ==',key_name='tempest-keypair-183406528',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c7e3f592e7141659581ae7f67c6af43',ramdisk_id='',reservation_id='r-sst2ny3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-640999933',owner_user_name='tempest-ServerActionsTestOtherA-640999933-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:58:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd76f1c0d9b42269fcc69f24c9f59e6',uuid=3f216945-199d-4047-8bc8-407d5842c536,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converting VIF {"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:58:28 user nova-compute[72409]:   <uuid>3f216945-199d-4047-8bc8-407d5842c536</uuid>
Aug 09 22:58:28 user nova-compute[72409]:   <name>instance-00000010</name>
Aug 09 22:58:28 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:58:28 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:58:28 user nova-compute[72409]:   <metadata>
Aug 09 22:58:28 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:58:28 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:58:28 user nova-compute[72409]:       <nova:name>tempest-ServerActionsTestOtherA-server-1401261704</nova:name>
Aug 09 22:58:28 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:58:27</nova:creationTime>
Aug 09 22:58:28 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:58:28 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:58:28 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:58:28 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:58:28 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:58:28 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:58:28 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:58:28 user nova-compute[72409]:       <nova:owner>
Aug 09 22:58:28 user nova-compute[72409]:         <nova:user uuid="efd76f1c0d9b42269fcc69f24c9f59e6">tempest-ServerActionsTestOtherA-640999933-project-member</nova:user>
Aug 09 22:58:28 user nova-compute[72409]:         <nova:project uuid="8c7e3f592e7141659581ae7f67c6af43">tempest-ServerActionsTestOtherA-640999933</nova:project>
Aug 09 22:58:28 user nova-compute[72409]:       </nova:owner>
Aug 09 22:58:28 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:58:28 user nova-compute[72409]:       <nova:ports>
Aug 09 22:58:28 user nova-compute[72409]:         <nova:port uuid="410a93bc-9f2d-473e-acfb-bf171c4bcf4a">
Aug 09 22:58:28 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 22:58:28 user nova-compute[72409]:         </nova:port>
Aug 09 22:58:28 user nova-compute[72409]:       </nova:ports>
Aug 09 22:58:28 user nova-compute[72409]:     </nova:instance>
Aug 09 22:58:28 user nova-compute[72409]:   </metadata>
Aug 09 22:58:28 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:58:28 user nova-compute[72409]:     <system>
Aug 09 22:58:28 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:58:28 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:58:28 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:58:28 user nova-compute[72409]:       <entry name="serial">3f216945-199d-4047-8bc8-407d5842c536</entry>
Aug 09 22:58:28 user nova-compute[72409]:       <entry name="uuid">3f216945-199d-4047-8bc8-407d5842c536</entry>
Aug 09 22:58:28 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:58:28 user nova-compute[72409]:     </system>
Aug 09 22:58:28 user nova-compute[72409]:   </sysinfo>
Aug 09 22:58:28 user nova-compute[72409]:   <os>
Aug 09 22:58:28 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:58:28 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:58:28 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:58:28 user nova-compute[72409]:   </os>
Aug 09 22:58:28 user nova-compute[72409]:   <features>
Aug 09 22:58:28 user nova-compute[72409]:     <acpi/>
Aug 09 22:58:28 user nova-compute[72409]:     <apic/>
Aug 09 22:58:28 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:58:28 user nova-compute[72409]:   </features>
Aug 09 22:58:28 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:58:28 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:58:28 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:58:28 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:58:28 user nova-compute[72409]:   </clock>
Aug 09 22:58:28 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:58:28 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:58:28 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:58:28 user nova-compute[72409]:   </cpu>
Aug 09 22:58:28 user nova-compute[72409]:   <devices>
Aug 09 22:58:28 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:58:28 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:58:28 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk"/>
Aug 09 22:58:28 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:58:28 user nova-compute[72409]:     </disk>
Aug 09 22:58:28 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:58:28 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:58:28 user nova-compute[72409]:       <source dev="/dev/sdd"/>
Aug 09 22:58:28 user nova-compute[72409]:       <target dev="vdb" bus="virtio"/>
Aug 09 22:58:28 user nova-compute[72409]:       <serial>b3dd997e-509b-4f16-813a-70e82d2d3168</serial>
Aug 09 22:58:28 user nova-compute[72409]:     </disk>
Aug 09 22:58:28 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:58:28 user nova-compute[72409]:       <mac address="fa:16:3e:a7:ea:25"/>
Aug 09 22:58:28 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:58:28 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:58:28 user nova-compute[72409]:       <target dev="tap410a93bc-9f"/>
Aug 09 22:58:28 user nova-compute[72409]:     </interface>
Aug 09 22:58:28 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:58:28 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/console.log" append="off"/>
Aug 09 22:58:28 user nova-compute[72409]:     </serial>
Aug 09 22:58:28 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:58:28 user nova-compute[72409]:     <video>
Aug 09 22:58:28 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:58:28 user nova-compute[72409]:     </video>
Aug 09 22:58:28 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:58:28 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:58:28 user nova-compute[72409]:     </rng>
Aug 09 22:58:28 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:58:28 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:58:28 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:58:28 user nova-compute[72409]:     </memballoon>
Aug 09 22:58:28 user nova-compute[72409]:   </devices>
Aug 09 22:58:28 user nova-compute[72409]: </domain>
Aug 09 22:58:28 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T22:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-869366492',display_name='tempest-ServerActionsTestOtherA-server-1401261704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-869366492',id=16,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzHC0syLklL8GtXvz6DwLHZAI3KijCzzG+c3H7vbfCfvBbdLu31zQrL5KQv6qO6LPapTOC2Zi0KeYbsTlIE+6d9oW1MPV8oBMrDCQEY9sL1aQ71vDiQHBGpACA1bJ0plQ==',key_name='tempest-keypair-183406528',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c7e3f592e7141659581ae7f67c6af43',ramdisk_id='',reservation_id='r-sst2ny3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-640999933',owner_user_name='tempest-ServerActionsTestOtherA-640999933-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:58:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd76f1c0d9b42269fcc69f24c9f59e6',uuid=3f216945-199d-4047-8bc8-407d5842c536,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converting VIF {"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG os_vif [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap410a93bc-9f, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap410a93bc-9f, col_values=(('external_ids', {'iface-id': '410a93bc-9f2d-473e-acfb-bf171c4bcf4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:ea:25', 'vm-uuid': '3f216945-199d-4047-8bc8-407d5842c536'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:28 user nova-compute[72409]: INFO os_vif [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f')
Aug 09 22:58:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:58:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] No VIF found with MAC fa:16:3e:a7:ea:25, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:58:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-8bdc9678-cabb-4f24-88f7-73c3401d29ef req-fd7ff8ce-a680-4d3e-b521-1bd709777ff3 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8bdc9678-cabb-4f24-88f7-73c3401d29ef req-fd7ff8ce-a680-4d3e-b521-1bd709777ff3 service nova] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8bdc9678-cabb-4f24-88f7-73c3401d29ef req-fd7ff8ce-a680-4d3e-b521-1bd709777ff3 service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8bdc9678-cabb-4f24-88f7-73c3401d29ef req-fd7ff8ce-a680-4d3e-b521-1bd709777ff3 service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-8bdc9678-cabb-4f24-88f7-73c3401d29ef req-fd7ff8ce-a680-4d3e-b521-1bd709777ff3 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] No waiting events found dispatching network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:30 user nova-compute[72409]: WARNING nova.compute.manager [req-8bdc9678-cabb-4f24-88f7-73c3401d29ef req-fd7ff8ce-a680-4d3e-b521-1bd709777ff3 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received unexpected event network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a for instance with vm_state active and task_state rebuild_spawning.
Aug 09 22:58:30 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621895.5860162, 3f216945-199d-4047-8bc8-407d5842c536 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:58:30 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 3f216945-199d-4047-8bc8-407d5842c536] VM Stopped (Lifecycle Event)
Aug 09 22:58:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c7809b04-ffe0-46e8-8f16-182b1f3cfa3c None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621912.3288732, 3f216945-199d-4047-8bc8-407d5842c536 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:58:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] VM Resumed (Lifecycle Event)
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 22:58:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Instance spawned successfully.
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:58:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621912.3322082, 3f216945-199d-4047-8bc8-407d5842c536 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:58:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] VM Started (Lifecycle Event)
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:58:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-3bb1f691-1d7a-4572-8491-d31de30602af req-cbd807b4-0f8d-4117-a0ae-3e5253eb50a3 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3bb1f691-1d7a-4572-8491-d31de30602af req-cbd807b4-0f8d-4117-a0ae-3e5253eb50a3 service nova] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3bb1f691-1d7a-4572-8491-d31de30602af req-cbd807b4-0f8d-4117-a0ae-3e5253eb50a3 service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3bb1f691-1d7a-4572-8491-d31de30602af req-cbd807b4-0f8d-4117-a0ae-3e5253eb50a3 service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-3bb1f691-1d7a-4572-8491-d31de30602af req-cbd807b4-0f8d-4117-a0ae-3e5253eb50a3 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] No waiting events found dispatching network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:32 user nova-compute[72409]: WARNING nova.compute.manager [req-3bb1f691-1d7a-4572-8491-d31de30602af req-cbd807b4-0f8d-4117-a0ae-3e5253eb50a3 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received unexpected event network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a for instance with vm_state active and task_state rebuild_spawning.
Aug 09 22:58:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG nova.objects.instance [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72409) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 22:58:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-619b73ca-f61b-4700-aff3-e62801769611 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:36 user nova-compute[72409]: INFO nova.compute.manager [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Rescuing
Aug 09 22:58:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "refresh_cache-6540903a-e102-40b3-833b-1ec5031c6d82" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:58:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquired lock "refresh_cache-6540903a-e102-40b3-833b-1ec5031c6d82" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:58:36 user nova-compute[72409]: DEBUG nova.network.neutron [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:58:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Updating instance_info_cache with network_info: [{"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:58:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Releasing lock "refresh_cache-6540903a-e102-40b3-833b-1ec5031c6d82" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:58:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-e21c0417-6e4c-4ad5-8254-71f246ea1920 req-91d51e54-15c2-4aba-b284-5093f1770bdd service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-unplugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e21c0417-6e4c-4ad5-8254-71f246ea1920 req-91d51e54-15c2-4aba-b284-5093f1770bdd service nova] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e21c0417-6e4c-4ad5-8254-71f246ea1920 req-91d51e54-15c2-4aba-b284-5093f1770bdd service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e21c0417-6e4c-4ad5-8254-71f246ea1920 req-91d51e54-15c2-4aba-b284-5093f1770bdd service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-e21c0417-6e4c-4ad5-8254-71f246ea1920 req-91d51e54-15c2-4aba-b284-5093f1770bdd service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] No waiting events found dispatching network-vif-unplugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:37 user nova-compute[72409]: WARNING nova.compute.manager [req-e21c0417-6e4c-4ad5-8254-71f246ea1920 req-91d51e54-15c2-4aba-b284-5093f1770bdd service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received unexpected event network-vif-unplugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 for instance with vm_state active and task_state rescuing.
Aug 09 22:58:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Instance destroyed successfully.
Aug 09 22:58:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Attempting a stable device rescue
Aug 09 22:58:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72409) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 22:58:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Instance directory exists: not creating {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 22:58:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Creating image(s)
Aug 09 22:58:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "/opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "/opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "/opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:38 user nova-compute[72409]: DEBUG nova.objects.instance [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6540903a-e102-40b3-833b-1ec5031c6d82 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "c69cb36f421ac9628efd7eb73d9b24d9da0f0620" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "c69cb36f421ac9628efd7eb73d9b24d9da0f0620" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620.part --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620.part --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:39 user nova-compute[72409]: DEBUG nova.virt.images [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] 71576621-9b36-40d1-86a2-9f0c972d217d was qcow2, converting to raw {{(pid=72409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 22:58:39 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 22:58:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620.part /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620.converted {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-99492286-bcfb-4810-8054-a7d0e9775b04 req-69fe7848-811f-44e0-9842-3dbc3dcb6e00 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-99492286-bcfb-4810-8054-a7d0e9775b04 req-69fe7848-811f-44e0-9842-3dbc3dcb6e00 service nova] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-99492286-bcfb-4810-8054-a7d0e9775b04 req-69fe7848-811f-44e0-9842-3dbc3dcb6e00 service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-99492286-bcfb-4810-8054-a7d0e9775b04 req-69fe7848-811f-44e0-9842-3dbc3dcb6e00 service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-99492286-bcfb-4810-8054-a7d0e9775b04 req-69fe7848-811f-44e0-9842-3dbc3dcb6e00 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] No waiting events found dispatching network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:39 user nova-compute[72409]: WARNING nova.compute.manager [req-99492286-bcfb-4810-8054-a7d0e9775b04 req-69fe7848-811f-44e0-9842-3dbc3dcb6e00 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received unexpected event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 for instance with vm_state active and task_state rescuing.
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620.part /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620.converted" returned: 0 in 0.505s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620.converted --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "c69cb36f421ac9628efd7eb73d9b24d9da0f0620" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.834s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "c69cb36f421ac9628efd7eb73d9b24d9da0f0620" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "c69cb36f421ac9628efd7eb73d9b24d9da0f0620" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620 --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620,backing_fmt=raw /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.rescue {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620,backing_fmt=raw /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.rescue" returned: 0 in 0.058s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "c69cb36f421ac9628efd7eb73d9b24d9da0f0620" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.objects.instance [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'migration_context' on Instance uuid 6540903a-e102-40b3-833b-1ec5031c6d82 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Start _get_guest_xml network_info=[{"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "vif_mac": "fa:16:3e:4b:b8:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '71576621-9b36-40d1-86a2-9f0c972d217d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGgyDOwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6540903a-e102-40b3-833b-1ec5031c6d82', 'attached_at': '', 'detached_at': '', 'volume_id': '2415b285-e97f-4c81-b5f8-06481a7d094c', 'serial': '2415b285-e97f-4c81-b5f8-06481a7d094c'}, 'mount_device': '/dev/vda', 'attachment_id': '2ac3d190-68c5-4014-b429-f2ae39a29b26', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.objects.instance [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'resources' on Instance uuid 6540903a-e102-40b3-833b-1ec5031c6d82 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.objects.instance [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'numa_topology' on Instance uuid 6540903a-e102-40b3-833b-1ec5031c6d82 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:40 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:58:40 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.objects.instance [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6540903a-e102-40b3-833b-1ec5031c6d82 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGgyDOwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:58:40 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:58:40 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:58:40 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[972d98f7-0fd8-4bd9-b6e1-2123b19a9cb0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xGgyDOwZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 22:58:40 user nova-compute[72409]: node.name = iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c
Aug 09 22:58:40 user nova-compute[72409]: node.tpgt = -1
Aug 09 22:58:40 user nova-compute[72409]: node.startup = automatic
Aug 09 22:58:40 user nova-compute[72409]: node.leading_login = No
Aug 09 22:58:40 user nova-compute[72409]: iface.iscsi_ifacename = default
Aug 09 22:58:40 user nova-compute[72409]: iface.net_ifacename = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.ipaddress = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.prefix_len = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.hwaddress = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.transport_name = tcp
Aug 09 22:58:40 user nova-compute[72409]: iface.initiatorname = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.state = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.vlan_id = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.vlan_priority = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.vlan_state = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.iface_num = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.mtu = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.port = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.bootproto = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.subnet_mask = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.gateway = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.dhcp_alt_client_id = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.dhcp_dns = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.dhcp_learn_iqn = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.dhcp_vendor_id_state = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.dhcp_vendor_id = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.dhcp_slp_da = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.fragmentation = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.gratuitous_arp = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.incoming_forwarding = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.tos_state = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.tos = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.ttl = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.delayed_ack = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.tcp_nagle = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.tcp_wsf_state = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.tcp_wsf = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.tcp_timer_scale = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.tcp_timestamp = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.redirect = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.def_task_mgmt_timeout = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.header_digest = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.data_digest = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.immediate_data = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.initial_r2t = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.data_seq_inorder = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.data_pdu_inorder = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.erl = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.max_receive_data_len = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.first_burst_len = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.max_outstanding_r2t = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.max_burst_len = 0
Aug 09 22:58:40 user nova-compute[72409]: iface.chap_auth = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.bidi_chap = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.strict_login_compliance = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.discovery_auth = <empty>
Aug 09 22:58:40 user nova-compute[72409]: iface.discovery_logout = <empty>
Aug 09 22:58:40 user nova-compute[72409]: node.discovery_address = <empty>
Aug 09 22:58:40 user nova-compute[72409]: node.discovery_port = 0
Aug 09 22:58:40 user nova-compute[72409]: node.discovery_type = static
Aug 09 22:58:40 user nova-compute[72409]: node.session.initial_cmdsn = 0
Aug 09 22:58:40 user nova-compute[72409]: node.session.initial_login_retry_max = 8
Aug 09 22:58:40 user nova-compute[72409]: node.session.xmit_thread_priority = -20
Aug 09 22:58:40 user nova-compute[72409]: node.session.cmds_max = 128
Aug 09 22:58:40 user nova-compute[72409]: node.session.queue_depth = 32
Aug 09 22:58:40 user nova-compute[72409]: node.session.nr_sessions = 1
Aug 09 22:58:40 user nova-compute[72409]: node.session.auth.authmethod = CHAP
Aug 09 22:58:40 user nova-compute[72409]: node.session.auth.username = xGgyDOwZ
Aug 09 22:58:40 user nova-compute[72409]: node.session.auth.password = ***
Aug 09 22:58:40 user nova-compute[72409]: node.session.auth.username_in = <empty>
Aug 09 22:58:40 user nova-compute[72409]: node.session.auth.password_in = <empty>
Aug 09 22:58:40 user nova-compute[72409]: node.session.auth.chap_algs = MD5
Aug 09 22:58:40 user nova-compute[72409]: node.session.timeo.replacement_timeout = 120
Aug 09 22:58:40 user nova-compute[72409]: node.session.err_timeo.abort_timeout = 15
Aug 09 22:58:40 user nova-compute[72409]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 22:58:40 user nova-compute[72409]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 22:58:40 user nova-compute[72409]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 22:58:40 user nova-compute[72409]: node.session.iscsi.FastAbort = Yes
Aug 09 22:58:40 user nova-compute[72409]: node.session.iscsi.InitialR2T = No
Aug 09 22:58:40 user nova-compute[72409]: node.session.iscsi.ImmediateData = Yes
Aug 09 22:58:40 user nova-compute[72409]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 22:58:40 user nova-compute[72409]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 22:58:40 user nova-compute[72409]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 22:58:40 user nova-compute[72409]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 22:58:40 user nova-compute[72409]: node.session.iscsi.MaxConnections = 1
Aug 09 22:58:40 user nova-compute[72409]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 22:58:40 user nova-compute[72409]: node.session.iscsi.ERL = 0
Aug 09 22:58:40 user nova-compute[72409]: node.session.scan = manual
Aug 09 22:58:40 user nova-compute[72409]: node.session.reopen_max = 0
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].address = 172.16.0.220
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].port = 3260
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].startup = manual
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].tcp.window_size = 524288
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].tcp.type_of_service = 0
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].timeo.logout_timeout = 15
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].timeo.login_timeout = 15
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].timeo.auth_timeout = 45
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].iscsi.DataDigest = None
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].iscsi.IFMarker = No
Aug 09 22:58:40 user nova-compute[72409]: node.conn[0].iscsi.OFMarker = No
Aug 09 22:58:40 user nova-compute[72409]: # END RECORD
Aug 09 22:58:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b553cd-63fa-4636-ab84-f60062b2820f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe5a4e0-f67e-430e-b92e-56b231717c48]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGgyDOwZ {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGgyDOwZ" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c12cea4-0667-42b1-b058-228ab317e7aa]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xGgyDOwZ'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3545c3e-2c98-4a16-9a68-b9fc644e2c91]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7312e309-f103-42f7-b2d8-970803ca28a1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:40 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:40 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:58:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:40 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:40 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:58:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] HCTL ('33', '0', '0', 0) found on session 20 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4462798f-f67b-4a17-b308-bef9d8cfdfd8]: (4, ('0 0 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Searching for a device in session 20 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGgyDOwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.205s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] <== connect_volume: return (207ms) {'type': 'block', 'scsi_wwn': '23239336465383561', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239336465383561', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-360915832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-360915832',id=21,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:57:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7dfbbb5a1d134adba458e9c592f6fada',ramdisk_id='',reservation_id='r-cwymbw5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-426575742',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:57:13Z,user_data=None,user_id='8bf771a74e994703bd1ed49add72cd14',uuid=6540903a-e102-40b3-833b-1ec5031c6d82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "vif_mac": "fa:16:3e:4b:b8:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converting VIF {"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "vif_mac": "fa:16:3e:4b:b8:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=0183f9ca-8c9d-4077-adfc-1d80ec039ba4,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0183f9ca-8c') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.objects.instance [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'pci_devices' on Instance uuid 6540903a-e102-40b3-833b-1ec5031c6d82 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:58:40 user nova-compute[72409]:   <uuid>6540903a-e102-40b3-833b-1ec5031c6d82</uuid>
Aug 09 22:58:40 user nova-compute[72409]:   <name>instance-00000015</name>
Aug 09 22:58:40 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:58:40 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:58:40 user nova-compute[72409]:   <metadata>
Aug 09 22:58:40 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:58:40 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:58:40 user nova-compute[72409]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-360915832</nova:name>
Aug 09 22:58:40 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:58:40</nova:creationTime>
Aug 09 22:58:40 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:58:40 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:58:40 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:58:40 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:58:40 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:58:40 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:58:40 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:58:40 user nova-compute[72409]:       <nova:owner>
Aug 09 22:58:40 user nova-compute[72409]:         <nova:user uuid="8bf771a74e994703bd1ed49add72cd14">tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member</nova:user>
Aug 09 22:58:40 user nova-compute[72409]:         <nova:project uuid="7dfbbb5a1d134adba458e9c592f6fada">tempest-ServerBootFromVolumeStableRescueTest-426575742</nova:project>
Aug 09 22:58:40 user nova-compute[72409]:       </nova:owner>
Aug 09 22:58:40 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:58:40 user nova-compute[72409]:       <nova:ports>
Aug 09 22:58:40 user nova-compute[72409]:         <nova:port uuid="0183f9ca-8c9d-4077-adfc-1d80ec039ba4">
Aug 09 22:58:40 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 22:58:40 user nova-compute[72409]:         </nova:port>
Aug 09 22:58:40 user nova-compute[72409]:       </nova:ports>
Aug 09 22:58:40 user nova-compute[72409]:     </nova:instance>
Aug 09 22:58:40 user nova-compute[72409]:   </metadata>
Aug 09 22:58:40 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:58:40 user nova-compute[72409]:     <system>
Aug 09 22:58:40 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:58:40 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:58:40 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:58:40 user nova-compute[72409]:       <entry name="serial">6540903a-e102-40b3-833b-1ec5031c6d82</entry>
Aug 09 22:58:40 user nova-compute[72409]:       <entry name="uuid">6540903a-e102-40b3-833b-1ec5031c6d82</entry>
Aug 09 22:58:40 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:58:40 user nova-compute[72409]:     </system>
Aug 09 22:58:40 user nova-compute[72409]:   </sysinfo>
Aug 09 22:58:40 user nova-compute[72409]:   <os>
Aug 09 22:58:40 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:58:40 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:58:40 user nova-compute[72409]:   </os>
Aug 09 22:58:40 user nova-compute[72409]:   <features>
Aug 09 22:58:40 user nova-compute[72409]:     <acpi/>
Aug 09 22:58:40 user nova-compute[72409]:     <apic/>
Aug 09 22:58:40 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:58:40 user nova-compute[72409]:   </features>
Aug 09 22:58:40 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:58:40 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:58:40 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:58:40 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:58:40 user nova-compute[72409]:   </clock>
Aug 09 22:58:40 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:58:40 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:58:40 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:58:40 user nova-compute[72409]:   </cpu>
Aug 09 22:58:40 user nova-compute[72409]:   <devices>
Aug 09 22:58:40 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:58:40 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:58:40 user nova-compute[72409]:       <source dev="/dev/sdb"/>
Aug 09 22:58:40 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:58:40 user nova-compute[72409]:       <serial>2415b285-e97f-4c81-b5f8-06481a7d094c</serial>
Aug 09 22:58:40 user nova-compute[72409]:     </disk>
Aug 09 22:58:40 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:58:40 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:58:40 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.rescue"/>
Aug 09 22:58:40 user nova-compute[72409]:       <target dev="vdb" bus="virtio"/>
Aug 09 22:58:40 user nova-compute[72409]:       <boot order="1"/>
Aug 09 22:58:40 user nova-compute[72409]:     </disk>
Aug 09 22:58:40 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:58:40 user nova-compute[72409]:       <mac address="fa:16:3e:4b:b8:45"/>
Aug 09 22:58:40 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:58:40 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:58:40 user nova-compute[72409]:       <target dev="tap0183f9ca-8c"/>
Aug 09 22:58:40 user nova-compute[72409]:     </interface>
Aug 09 22:58:40 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:58:40 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/console.log" append="off"/>
Aug 09 22:58:40 user nova-compute[72409]:     </serial>
Aug 09 22:58:40 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:58:40 user nova-compute[72409]:     <video>
Aug 09 22:58:40 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:58:40 user nova-compute[72409]:     </video>
Aug 09 22:58:40 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:58:40 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:58:40 user nova-compute[72409]:     </rng>
Aug 09 22:58:40 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:58:40 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:58:40 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:58:40 user nova-compute[72409]:     </memballoon>
Aug 09 22:58:40 user nova-compute[72409]:   </devices>
Aug 09 22:58:40 user nova-compute[72409]: </domain>
Aug 09 22:58:40 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:58:40 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Instance destroyed successfully.
Aug 09 22:58:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] No VIF found with MAC fa:16:3e:4b:b8:45, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621906.1013649, 451ed986-57e6-485e-90b1-231c5ea3db20 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:58:41 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] VM Stopped (Lifecycle Event)
Aug 09 22:58:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4b05d300-7692-481f-8e2e-5d310a53a72d None None] [instance: 451ed986-57e6-485e-90b1-231c5ea3db20] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:41 user nova-compute[72409]: INFO nova.compute.manager [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Terminating instance
Aug 09 22:58:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-a34c9eca-149e-4ac3-98a8-e9a604bd29d9 req-e20a42d6-9012-4e22-b92f-31de582834ea service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Received event network-vif-unplugged-d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a34c9eca-149e-4ac3-98a8-e9a604bd29d9 req-e20a42d6-9012-4e22-b92f-31de582834ea service nova] Acquiring lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a34c9eca-149e-4ac3-98a8-e9a604bd29d9 req-e20a42d6-9012-4e22-b92f-31de582834ea service nova] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a34c9eca-149e-4ac3-98a8-e9a604bd29d9 req-e20a42d6-9012-4e22-b92f-31de582834ea service nova] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-a34c9eca-149e-4ac3-98a8-e9a604bd29d9 req-e20a42d6-9012-4e22-b92f-31de582834ea service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] No waiting events found dispatching network-vif-unplugged-d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-a34c9eca-149e-4ac3-98a8-e9a604bd29d9 req-e20a42d6-9012-4e22-b92f-31de582834ea service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Received event network-vif-unplugged-d0a9be1b-f3b7-409a-8b27-d39ad6529435 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:58:42 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Instance destroyed successfully.
Aug 09 22:58:42 user nova-compute[72409]: DEBUG nova.objects.instance [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lazy-loading 'resources' on Instance uuid e91a0018-b2f9-4ddf-b082-4b50d815ca54 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1875010930',display_name='tempest-TestVolumeBootPattern-server-1875010930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1875010930',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:57:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-u9il8uyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:57:18Z,user_data=None,user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=e91a0018-b2f9-4ddf-b082-4b50d815ca54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "address": "fa:16:3e:c3:3d:43", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a9be1b-f3", "ovs_interfaceid": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "address": "fa:16:3e:c3:3d:43", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a9be1b-f3", "ovs_interfaceid": "d0a9be1b-f3b7-409a-8b27-d39ad6529435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3d:43,bridge_name='br-int',has_traffic_filtering=True,id=d0a9be1b-f3b7-409a-8b27-d39ad6529435,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a9be1b-f3') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_vif [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3d:43,bridge_name='br-int',has_traffic_filtering=True,id=d0a9be1b-f3b7-409a-8b27-d39ad6529435,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a9be1b-f3') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0a9be1b-f3, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:42 user nova-compute[72409]: INFO os_vif [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3d:43,bridge_name='br-int',has_traffic_filtering=True,id=d0a9be1b-f3b7-409a-8b27-d39ad6529435,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a9be1b-f3')
Aug 09 22:58:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LjyMNkiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:58:42 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[94680c43-6920-4a3c-b775-0a6f3b8904eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e46a15-dd75-4869-99e9-4d542740a41f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:42 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:42 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:58:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:58:42 user nova-compute[72409]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 (non-flash)
Aug 09 22:58:42 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:58:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e8432ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9589742a-73ce-4bc7-9e02-2f6547e26b81]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12d7f19-394b-412c-b15f-3497267ae525]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8d2dbc-d406-44f9-9081-1a62774db46d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[90537cfb-96eb-4b31-9612-0a5fcc619bde]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[004c9378-5828-4238-8060-4e0422a59a2f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fcbbec-2ff0-444f-a9f4-65b928359ee2]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767, portal: 172.16.0.220,3260]
Aug 09 22:58:42 user nova-compute[72409]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767, portal: 172.16.0.220,3260] successful.
Aug 09 22:58:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48aa5554-7233-4acf-92d3-c7df72698767 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a773bc9b-8a3e-4a52-8094-c6b725a55d0a]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:58:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== disconnect_volume: return (336ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:58:43 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Deleting instance files /opt/stack/data/nova/instances/e91a0018-b2f9-4ddf-b082-4b50d815ca54_del
Aug 09 22:58:43 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Deletion of /opt/stack/data/nova/instances/e91a0018-b2f9-4ddf-b082-4b50d815ca54_del complete
Aug 09 22:58:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:43 user nova-compute[72409]: INFO nova.compute.manager [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Took 1.77 seconds to destroy the instance on the hypervisor.
Aug 09 22:58:43 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-b723eb5a-cc4e-4379-88a6-27fa054d8392 req-7e3fe26c-58c9-41c4-9bb6-286fd7049e83 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b723eb5a-cc4e-4379-88a6-27fa054d8392 req-7e3fe26c-58c9-41c4-9bb6-286fd7049e83 service nova] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b723eb5a-cc4e-4379-88a6-27fa054d8392 req-7e3fe26c-58c9-41c4-9bb6-286fd7049e83 service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b723eb5a-cc4e-4379-88a6-27fa054d8392 req-7e3fe26c-58c9-41c4-9bb6-286fd7049e83 service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-b723eb5a-cc4e-4379-88a6-27fa054d8392 req-7e3fe26c-58c9-41c4-9bb6-286fd7049e83 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] No waiting events found dispatching network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:43 user nova-compute[72409]: WARNING nova.compute.manager [req-b723eb5a-cc4e-4379-88a6-27fa054d8392 req-7e3fe26c-58c9-41c4-9bb6-286fd7049e83 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received unexpected event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 for instance with vm_state active and task_state rescuing.
Aug 09 22:58:43 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-edb5deda-a623-4f31-ac1e-c02b0eb59e79 req-d7d3dd6e-4c1d-4d4b-b923-06a35cb1bdff service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Received event network-vif-plugged-d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-edb5deda-a623-4f31-ac1e-c02b0eb59e79 req-d7d3dd6e-4c1d-4d4b-b923-06a35cb1bdff service nova] Acquiring lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-edb5deda-a623-4f31-ac1e-c02b0eb59e79 req-d7d3dd6e-4c1d-4d4b-b923-06a35cb1bdff service nova] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-edb5deda-a623-4f31-ac1e-c02b0eb59e79 req-d7d3dd6e-4c1d-4d4b-b923-06a35cb1bdff service nova] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-edb5deda-a623-4f31-ac1e-c02b0eb59e79 req-d7d3dd6e-4c1d-4d4b-b923-06a35cb1bdff service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] No waiting events found dispatching network-vif-plugged-d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:43 user nova-compute[72409]: WARNING nova.compute.manager [req-edb5deda-a623-4f31-ac1e-c02b0eb59e79 req-d7d3dd6e-4c1d-4d4b-b923-06a35cb1bdff service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Received unexpected event network-vif-plugged-d0a9be1b-f3b7-409a-8b27-d39ad6529435 for instance with vm_state active and task_state deleting.
Aug 09 22:58:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-edb5deda-a623-4f31-ac1e-c02b0eb59e79 req-d7d3dd6e-4c1d-4d4b-b923-06a35cb1bdff service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Received event network-vif-deleted-d0a9be1b-f3b7-409a-8b27-d39ad6529435 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:43 user nova-compute[72409]: INFO nova.compute.manager [req-edb5deda-a623-4f31-ac1e-c02b0eb59e79 req-d7d3dd6e-4c1d-4d4b-b923-06a35cb1bdff service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Neutron deleted interface d0a9be1b-f3b7-409a-8b27-d39ad6529435; detaching it from the instance and deleting it from the info cache
Aug 09 22:58:43 user nova-compute[72409]: DEBUG nova.network.neutron [req-edb5deda-a623-4f31-ac1e-c02b0eb59e79 req-d7d3dd6e-4c1d-4d4b-b923-06a35cb1bdff service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:58:43 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Took 0.84 seconds to deallocate network for instance.
Aug 09 22:58:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-edb5deda-a623-4f31-ac1e-c02b0eb59e79 req-d7d3dd6e-4c1d-4d4b-b923-06a35cb1bdff service nova] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Detach interface failed, port_id=d0a9be1b-f3b7-409a-8b27-d39ad6529435, reason: Instance e91a0018-b2f9-4ddf-b082-4b50d815ca54 could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 22:58:44 user nova-compute[72409]: INFO nova.compute.manager [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Took 0.84 seconds to detach 1 volumes for instance.
Aug 09 22:58:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Deleting volume: 48aa5554-7233-4acf-92d3-c7df72698767 {{(pid=72409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 22:58:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-ea14a5d1-4d66-4934-af0a-552f00088e83 req-78fc6b0a-0971-4472-95a2-44f8d5b7256d service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ea14a5d1-4d66-4934-af0a-552f00088e83 req-78fc6b0a-0971-4472-95a2-44f8d5b7256d service nova] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ea14a5d1-4d66-4934-af0a-552f00088e83 req-78fc6b0a-0971-4472-95a2-44f8d5b7256d service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ea14a5d1-4d66-4934-af0a-552f00088e83 req-78fc6b0a-0971-4472-95a2-44f8d5b7256d service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-ea14a5d1-4d66-4934-af0a-552f00088e83 req-78fc6b0a-0971-4472-95a2-44f8d5b7256d service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] No waiting events found dispatching network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:58:45 user nova-compute[72409]: WARNING nova.compute.manager [req-ea14a5d1-4d66-4934-af0a-552f00088e83 req-78fc6b0a-0971-4472-95a2-44f8d5b7256d service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received unexpected event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 for instance with vm_state active and task_state rescuing.
Aug 09 22:58:45 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Deleted allocations for instance e91a0018-b2f9-4ddf-b082-4b50d815ca54
Aug 09 22:58:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-71e84b87-f573-4be2-bbae-5b7f5115aa2f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "e91a0018-b2f9-4ddf-b082-4b50d815ca54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.270s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Removed pending event for 6540903a-e102-40b3-833b-1ec5031c6d82 due to event {{(pid=72409) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621925.6263535, 6540903a-e102-40b3-833b-1ec5031c6d82 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:58:45 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] VM Resumed (Lifecycle Event)
Aug 09 22:58:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-00d2ac12-e8a8-4385-81e4-25f2e3d7103b tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:58:45 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 22:58:45 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621925.6307971, 6540903a-e102-40b3-833b-1ec5031c6d82 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:58:45 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] VM Started (Lifecycle Event)
Aug 09 22:58:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:58:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:48 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:58:50 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:58:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:51 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:58:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:52 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:58:53 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:58:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:58:54 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:58:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:54 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:58:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621922.5906603, e91a0018-b2f9-4ddf-b082-4b50d815ca54 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:58:57 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] VM Stopped (Lifecycle Event)
Aug 09 22:58:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d5875e09-a873-493f-be93-9f472b438976 None None] [instance: e91a0018-b2f9-4ddf-b082-4b50d815ca54] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:58:58 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:58:58 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7122MB free_disk=25.30266571044922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5b7906a3-e02b-49a3-9a56-fc34a8730238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c17c9b77-8e04-432c-9634-c4bee2eb8889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c513e397-28f7-4d93-8487-257becbef9d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 6540903a-e102-40b3-833b-1ec5031c6d82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 65d39a39-3616-40db-906b-d4327e1d63c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 913c4e3b-f449-45fa-9ca7-3cef4b982679 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3b3ff97a-c2d6-4a63-8150-cc22f5903fae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 22:58:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:58:59 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:58:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 22:59:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-c17c9b77-8e04-432c-9634-c4bee2eb8889" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:59:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-c17c9b77-8e04-432c-9634-c4bee2eb8889" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:59:00 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 22:59:00 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Updating instance_info_cache with network_info: [{"id": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "address": "fa:16:3e:a6:51:84", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb543e82-69", "ovs_interfaceid": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:59:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-c17c9b77-8e04-432c-9634-c4bee2eb8889" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:59:00 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 22:59:00 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:59:00 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:59:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "c513e397-28f7-4d93-8487-257becbef9d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:03 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'flavor' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "c513e397-28f7-4d93-8487-257becbef9d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:03 user nova-compute[72409]: DEBUG nova.objects.instance [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'flavor' on Instance uuid 65d39a39-3616-40db-906b-d4327e1d63c5 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "c513e397-28f7-4d93-8487-257becbef9d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:03 user nova-compute[72409]: INFO nova.compute.manager [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Attaching volume ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 to /dev/vdb
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG os_brick.utils [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2445372a-b650-493f-be73-e0890091500b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a798af-2770-48fd-b972-dd91247a45f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[919d734e-28c0-473d-9b44-427deedf676e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d18c272-4868-4e82-b974-5fdc8c1770cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:04 user nova-compute[72409]: INFO nova.compute.manager [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Attaching volume 23978613-d1bf-48c8-b5e7-83727d93e2cd to /dev/vdb
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:59:04 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaf0bbe-70b4-4014-a611-b04eeca0ccc6]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG os_brick.utils [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating existing volume attachment record: 88fc7445-f993-484a-872f-5911c88e18e6 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG os_brick.utils [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0297e334-78e7-4ee2-8fc5-095c2c57992d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[52525933-cece-4509-b2f1-b6b55181682f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c479db67-624a-44f0-9f01-526ccd83164d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b4df95-1343-47ac-a2a4-3896b26ccecf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:59:04 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:59:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[89da5b4d-dd91-4991-94a4-b9c3a0aaae93]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG os_brick.utils [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:59:04 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updating existing volume attachment record: 243add46-7743-47d2-85bb-9baa75fb9499 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 22:59:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZmAoLng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:59:13 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:59:13 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:59:13 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dec56c-a27f-4e57-9dbc-805eef28ad66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:59:13 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0925d70-a3d1-43c4-9fd1-2da1218fa0c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd] added
Aug 09 22:59:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d7540b-a50d-48f9-a0f9-cf7ee344e207]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fd9896-9e06-4172-9f2d-d70d2c9a7919]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZmAoLng {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZmAoLng" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba60a650-82ae-47ec-9e9b-a2a5867e6032]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aZmAoLng'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dde932-9934-4953-8a22-17ac8a05573c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da890f9-bf2a-4d20-84a9-da1a869736e5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:13 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:13 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[052edd77-5fd0-4eeb-a6d5-ee703afd40aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260]
Aug 09 22:59:13 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260] successful.
Aug 09 22:59:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqbIjKzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:59:13 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc09f91-b937-4f6d-807f-12ffc6dbbe74]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5ee0ba-1627-44ae-82e9-7e85844819d0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:13 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:13 user nova-compute[72409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:13 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:13 user nova-compute[72409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e495d3db-48ec-4605-8304-6d586ebcb900]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:59:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZmAoLng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23864363365643063', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864363365643063', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.069s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:59:14 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:59:14 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'flavor' on Instance uuid 65d39a39-3616-40db-906b-d4327e1d63c5 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdb4cf8-1972-436e-aecc-0d6c8873c811]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:59:14 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 22:59:14 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:59:14 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 22:59:14 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:59:14 user nova-compute[72409]:   <serial>23978613-d1bf-48c8-b5e7-83727d93e2cd</serial>
Aug 09 22:59:14 user nova-compute[72409]: </disk>
Aug 09 22:59:14 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5948f2d-e494-4ea1-88d7-68c44a9564d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35] added
Aug 09 22:59:14 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5982615-8901-40ef-8050-f137175d376f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b98ebae-aef9-4ffb-a104-3f08641a9011]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqbIjKzx {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqbIjKzx" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de94204-3c8c-456a-b07e-d52ad61a214e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RqbIjKzx'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7384ac2-fdc9-43e6-b844-530f121a46a1]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d74b49-df41-4909-9c27-53ca1f82129d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:14 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:14 user nova-compute[72409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:14 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:14 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:14 user nova-compute[72409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:14 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b68689-850a-4576-a353-448685953608]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260]
Aug 09 22:59:14 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260] successful.
Aug 09 22:59:14 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4bc2b5-c508-4f75-b213-b31051186705]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77f4274-9cde-41cd-bcf6-8f8b91a35ff5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:15 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:15 user nova-compute[72409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:15 user nova-compute[72409]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 22:59:15 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:15 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:15 user nova-compute[72409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:15 user nova-compute[72409]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 22:59:15 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a51b929-7726-4fb0-a8eb-687e206f67dd]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqbIjKzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] No VIF found with MAC fa:16:3e:04:8a:27, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:59:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0d1e3d30-057f-4a9b-9474-7d06f84859d5 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.159s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] <== connect_volume: return (2418ms) {'type': 'block', 'scsi_wwn': '23863343064623135', 'path': '/dev/sde'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863343064623135', 'path': '/dev/sde'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'flavor' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 22:59:16 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:59:16 user nova-compute[72409]:   <source dev="/dev/sde"/>
Aug 09 22:59:16 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 22:59:16 user nova-compute[72409]:   <serial>ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35</serial>
Aug 09 22:59:16 user nova-compute[72409]: </disk>
Aug 09 22:59:16 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] No VIF found with MAC fa:16:3e:26:c6:8e, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8810dc07-b8b1-45d8-b4b1-281f10903073 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "c513e397-28f7-4d93-8487-257becbef9d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.696s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Acquiring lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Acquiring lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:16 user nova-compute[72409]: INFO nova.compute.manager [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Terminating instance
Aug 09 22:59:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-4e53f7b1-d935-465b-86ac-ced4a80f4950 req-a9b01e18-7536-4eb4-95a7-5b0b37f2040d service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Received event network-vif-unplugged-63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4e53f7b1-d935-465b-86ac-ced4a80f4950 req-a9b01e18-7536-4eb4-95a7-5b0b37f2040d service nova] Acquiring lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4e53f7b1-d935-465b-86ac-ced4a80f4950 req-a9b01e18-7536-4eb4-95a7-5b0b37f2040d service nova] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4e53f7b1-d935-465b-86ac-ced4a80f4950 req-a9b01e18-7536-4eb4-95a7-5b0b37f2040d service nova] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-4e53f7b1-d935-465b-86ac-ced4a80f4950 req-a9b01e18-7536-4eb4-95a7-5b0b37f2040d service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] No waiting events found dispatching network-vif-unplugged-63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-4e53f7b1-d935-465b-86ac-ced4a80f4950 req-a9b01e18-7536-4eb4-95a7-5b0b37f2040d service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Received event network-vif-unplugged-63866404-07d4-4f53-8a09-095fd6c88dfd for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:17 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Instance destroyed successfully.
Aug 09 22:59:17 user nova-compute[72409]: DEBUG nova.objects.instance [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lazy-loading 'resources' on Instance uuid 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-148069530',display_name='tempest-VolumesNegativeTest-instance-148069530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-148069530',id=24,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:57:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08f6b7f15700441388dba7173591367d',ramdisk_id='',reservation_id='r-d10lqkag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1680149611',owner_user_name='tempest-VolumesNegativeTest-1680149611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:57:35Z,user_data=None,user_id='3a6f342aeec444d58f88ae992caae65a',uuid=0c9c767c-ca61-4ed3-b0e9-6e039dd86c78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63866404-07d4-4f53-8a09-095fd6c88dfd", "address": "fa:16:3e:4c:95:bd", "network": {"id": "bbd83195-bedb-45fc-9f72-538258cfd53f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1eb3465793574a31b89a7979a72d4df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63866404-07", "ovs_interfaceid": "63866404-07d4-4f53-8a09-095fd6c88dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Converting VIF {"id": "63866404-07d4-4f53-8a09-095fd6c88dfd", "address": "fa:16:3e:4c:95:bd", "network": {"id": "bbd83195-bedb-45fc-9f72-538258cfd53f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1eb3465793574a31b89a7979a72d4df9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63866404-07", "ovs_interfaceid": "63866404-07d4-4f53-8a09-095fd6c88dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:95:bd,bridge_name='br-int',has_traffic_filtering=True,id=63866404-07d4-4f53-8a09-095fd6c88dfd,network=Network(bbd83195-bedb-45fc-9f72-538258cfd53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63866404-07') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG os_vif [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:95:bd,bridge_name='br-int',has_traffic_filtering=True,id=63866404-07d4-4f53-8a09-095fd6c88dfd,network=Network(bbd83195-bedb-45fc-9f72-538258cfd53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63866404-07') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63866404-07, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:59:17 user nova-compute[72409]: INFO os_vif [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:95:bd,bridge_name='br-int',has_traffic_filtering=True,id=63866404-07d4-4f53-8a09-095fd6c88dfd,network=Network(bbd83195-bedb-45fc-9f72-538258cfd53f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63866404-07')
Aug 09 22:59:17 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Deleting instance files /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78_del
Aug 09 22:59:17 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Deletion of /opt/stack/data/nova/instances/0c9c767c-ca61-4ed3-b0e9-6e039dd86c78_del complete
Aug 09 22:59:17 user nova-compute[72409]: INFO nova.compute.manager [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 09 22:59:17 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:59:17 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:59:18 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:59:18 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Took 0.57 seconds to deallocate network for instance.
Aug 09 22:59:18 user nova-compute[72409]: DEBUG nova.compute.manager [req-adb99d72-3787-44c5-942b-711ce8dbf78f req-1d3bc0bf-dab8-4c2d-8e7e-275033e0b755 service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Received event network-vif-deleted-63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:18 user nova-compute[72409]: INFO nova.compute.manager [req-adb99d72-3787-44c5-942b-711ce8dbf78f req-1d3bc0bf-dab8-4c2d-8e7e-275033e0b755 service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Neutron deleted interface 63866404-07d4-4f53-8a09-095fd6c88dfd; detaching it from the instance and deleting it from the info cache
Aug 09 22:59:18 user nova-compute[72409]: DEBUG nova.network.neutron [req-adb99d72-3787-44c5-942b-711ce8dbf78f req-1d3bc0bf-dab8-4c2d-8e7e-275033e0b755 service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:59:18 user nova-compute[72409]: DEBUG nova.compute.manager [req-adb99d72-3787-44c5-942b-711ce8dbf78f req-1d3bc0bf-dab8-4c2d-8e7e-275033e0b755 service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Detach interface failed, port_id=63866404-07d4-4f53-8a09-095fd6c88dfd, reason: Instance 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78 could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 22:59:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:18 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:59:18 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:59:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Stashing vm_state: active {{(pid=72409) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 22:59:18 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Deleted allocations for instance 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78
Aug 09 22:59:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-47f0828c-103b-458c-bf6e-e1b6afbe041a tempest-VolumesNegativeTest-1680149611 tempest-VolumesNegativeTest-1680149611-project-member] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG nova.objects.instance [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'pci_requests' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:59:19 user nova-compute[72409]: INFO nova.compute.claims [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Claim successful on node user
Aug 09 22:59:19 user nova-compute[72409]: DEBUG nova.objects.instance [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'resources' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG nova.objects.instance [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'pci_devices' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:19 user nova-compute[72409]: INFO nova.compute.resource_tracker [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating resource usage from migration 892604ee-5dbb-4bea-9fa5-8c96ad738b30
Aug 09 22:59:19 user nova-compute[72409]: DEBUG nova.compute.manager [req-34517fe8-1a7f-4c62-8806-ce8396667c02 req-2380f86b-3e01-4507-bdca-086094de4027 service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Received event network-vif-plugged-63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-34517fe8-1a7f-4c62-8806-ce8396667c02 req-2380f86b-3e01-4507-bdca-086094de4027 service nova] Acquiring lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-34517fe8-1a7f-4c62-8806-ce8396667c02 req-2380f86b-3e01-4507-bdca-086094de4027 service nova] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-34517fe8-1a7f-4c62-8806-ce8396667c02 req-2380f86b-3e01-4507-bdca-086094de4027 service nova] Lock "0c9c767c-ca61-4ed3-b0e9-6e039dd86c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG nova.compute.manager [req-34517fe8-1a7f-4c62-8806-ce8396667c02 req-2380f86b-3e01-4507-bdca-086094de4027 service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] No waiting events found dispatching network-vif-plugged-63866404-07d4-4f53-8a09-095fd6c88dfd {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:19 user nova-compute[72409]: WARNING nova.compute.manager [req-34517fe8-1a7f-4c62-8806-ce8396667c02 req-2380f86b-3e01-4507-bdca-086094de4027 service nova] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Received unexpected event network-vif-plugged-63866404-07d4-4f53-8a09-095fd6c88dfd for instance with vm_state deleted and task_state None.
Aug 09 22:59:19 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.460s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:19 user nova-compute[72409]: INFO nova.compute.manager [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Migrating
Aug 09 22:59:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:59:19 user nova-compute[72409]: INFO nova.compute.rpcapi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 09 22:59:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquired lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:59:19 user nova-compute[72409]: DEBUG nova.network.neutron [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:59:20 user nova-compute[72409]: DEBUG nova.network.neutron [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating instance_info_cache with network_info: [{"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:59:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Releasing lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:59:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Starting migrate_disk_and_power_off {{(pid=72409) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 22:59:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:20 user nova-compute[72409]: DEBUG nova.compute.manager [req-9d500a7e-1bf0-4d8b-b604-3ae1c6320b51 req-e24d64a3-6102-46f8-8159-1fd41912f5d3 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-unplugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9d500a7e-1bf0-4d8b-b604-3ae1c6320b51 req-e24d64a3-6102-46f8-8159-1fd41912f5d3 service nova] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9d500a7e-1bf0-4d8b-b604-3ae1c6320b51 req-e24d64a3-6102-46f8-8159-1fd41912f5d3 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9d500a7e-1bf0-4d8b-b604-3ae1c6320b51 req-e24d64a3-6102-46f8-8159-1fd41912f5d3 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:20 user nova-compute[72409]: DEBUG nova.compute.manager [req-9d500a7e-1bf0-4d8b-b604-3ae1c6320b51 req-e24d64a3-6102-46f8-8159-1fd41912f5d3 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] No waiting events found dispatching network-vif-unplugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:20 user nova-compute[72409]: WARNING nova.compute.manager [req-9d500a7e-1bf0-4d8b-b604-3ae1c6320b51 req-e24d64a3-6102-46f8-8159-1fd41912f5d3 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received unexpected event network-vif-unplugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 for instance with vm_state active and task_state resize_migrating.
Aug 09 22:59:21 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Instance destroyed successfully.
Aug 09 22:59:21 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2097419676',display_name='tempest-ServerActionsTestOtherB-server-2097419676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2097419676',id=19,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDelHCC8nFCHRTmFXWR19BOOB/f+NPR90u8i8YXxlReJTIRJmpJsKKUPRbCWzHe6UX+HR9F8ZTKdA6A0YGmKOztUWCiwbCDEi2c3eCmLXAc66rx+Q4ob5pL4kfTx6LhQUg==',key_name='tempest-keypair-351454578',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a302bac664904169ad012943400598db',ramdisk_id='',reservation_id='r-pfgn9xa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-68548202',owner_user_name='tempest-ServerActionsTestOtherB-68548202-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d662607342934fb7babc31e155f5d915',uuid=c513e397-28f7-4d93-8487-257becbef9d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-372540247-network", "vif_mac": "fa:16:3e:26:c6:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converting VIF {"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-372540247-network", "vif_mac": "fa:16:3e:26:c6:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_vif [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6afaf787-02, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:59:21 user nova-compute[72409]: INFO os_vif [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02')
Aug 09 22:59:21 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqbIjKzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:59:21 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e75558-d723-470e-9d5a-ae2d1b07768f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4c41cc-112a-49d3-8f34-82d147cd006d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:21 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:21 user nova-compute[72409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:21 user nova-compute[72409]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 22:59:21 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:21 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:21 user nova-compute[72409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:21 user nova-compute[72409]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 22:59:21 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e845c84c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'): ({'sde'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Removing single pathed devices sde {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01a24cb-c872-476b-a139-f0c9c71584ff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84290e9-5cee-4319-b742-0be42049da34]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Flushing IO for device /dev/sde {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0028a851-06ac-4c5b-a250-aba8c3a0aee4]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce03a55-51b2-4410-b2f9-eed16cff7f4e]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88d80d6-9572-4cda-a0c7-9ae649b39db9]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc41a37b-a978-47b9-9e4b-2bf608521b58]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260]
Aug 09 22:59:21 user nova-compute[72409]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260] successful.
Aug 09 22:59:21 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1a7da4-c48b-48ec-9c9f-863b6ab1298e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] <== disconnect_volume: return (331ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-2220c737-a1c5-4e24-9061-1e1fd3038166 req-9bcd5c07-3151-49d2-95d9-5bfd35552a2f service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-changed-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-2220c737-a1c5-4e24-9061-1e1fd3038166 req-9bcd5c07-3151-49d2-95d9-5bfd35552a2f service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Refreshing instance network info cache due to event network-changed-a80bd290-a75e-4702-b917-3319bee30a60. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2220c737-a1c5-4e24-9061-1e1fd3038166 req-9bcd5c07-3151-49d2-95d9-5bfd35552a2f service nova] Acquiring lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2220c737-a1c5-4e24-9061-1e1fd3038166 req-9bcd5c07-3151-49d2-95d9-5bfd35552a2f service nova] Acquired lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG nova.network.neutron [req-2220c737-a1c5-4e24-9061-1e1fd3038166 req-9bcd5c07-3151-49d2-95d9-5bfd35552a2f service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Refreshing network info cache for port a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:59:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3_resize/disk /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CMD "cp -r /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3_resize/disk /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk" returned: 0 in 0.329s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3_resize/disk.info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk.info {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CMD "cp -r /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3_resize/disk.info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk.info" returned: 0 in 0.038s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:22 user nova-compute[72409]: DEBUG nova.network.neutron [req-2220c737-a1c5-4e24-9061-1e1fd3038166 req-9bcd5c07-3151-49d2-95d9-5bfd35552a2f service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updated VIF entry in instance network info cache for port a80bd290-a75e-4702-b917-3319bee30a60. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:59:22 user nova-compute[72409]: DEBUG nova.network.neutron [req-2220c737-a1c5-4e24-9061-1e1fd3038166 req-9bcd5c07-3151-49d2-95d9-5bfd35552a2f service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updating instance_info_cache with network_info: [{"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:59:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2220c737-a1c5-4e24-9061-1e1fd3038166 req-9bcd5c07-3151-49d2-95d9-5bfd35552a2f service nova] Releasing lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:59:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-0a1dcc5c-a19e-4ab7-b5ef-f4edeb88fecf req-372c59ed-f329-492a-b67c-30988d9dcb8c service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0a1dcc5c-a19e-4ab7-b5ef-f4edeb88fecf req-372c59ed-f329-492a-b67c-30988d9dcb8c service nova] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0a1dcc5c-a19e-4ab7-b5ef-f4edeb88fecf req-372c59ed-f329-492a-b67c-30988d9dcb8c service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0a1dcc5c-a19e-4ab7-b5ef-f4edeb88fecf req-372c59ed-f329-492a-b67c-30988d9dcb8c service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-0a1dcc5c-a19e-4ab7-b5ef-f4edeb88fecf req-372c59ed-f329-492a-b67c-30988d9dcb8c service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] No waiting events found dispatching network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:22 user nova-compute[72409]: WARNING nova.compute.manager [req-0a1dcc5c-a19e-4ab7-b5ef-f4edeb88fecf req-372c59ed-f329-492a-b67c-30988d9dcb8c service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received unexpected event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 for instance with vm_state active and task_state resize_migrating.
Aug 09 22:59:23 user nova-compute[72409]: DEBUG nova.network.neutron [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Port 6afaf787-02f9-400f-b7a9-b0aa4df58939 binding to destination host user is already ACTIVE {{(pid=72409) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 22:59:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:59:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquired lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:59:24 user nova-compute[72409]: DEBUG nova.network.neutron [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:59:24 user nova-compute[72409]: DEBUG nova.network.neutron [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating instance_info_cache with network_info: [{"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:59:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Releasing lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:59:24 user nova-compute[72409]: DEBUG os_brick.utils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e5f8f4-2967-402d-9073-efcf22900676]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6092fc99-da18-4201-a740-8e35651c2b28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[301bf016-a74b-4308-98bb-b51144bf90c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2d4416-7c72-452f-a3b8-e99f01a3362f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 22:59:25 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 22:59:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3422a829-553f-4cde-9460-b402162e35fd]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 22:59:25 user nova-compute[72409]: DEBUG os_brick.utils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:59:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:26 user nova-compute[72409]: DEBUG nova.compute.manager [req-79296836-f617-4060-81b3-24400d496379 req-580327cc-4966-41e2-b425-6027d699ac9e service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-changed-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:26 user nova-compute[72409]: DEBUG nova.compute.manager [req-79296836-f617-4060-81b3-24400d496379 req-580327cc-4966-41e2-b425-6027d699ac9e service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Refreshing instance network info cache due to event network-changed-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:59:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-79296836-f617-4060-81b3-24400d496379 req-580327cc-4966-41e2-b425-6027d699ac9e service nova] Acquiring lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:59:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-79296836-f617-4060-81b3-24400d496379 req-580327cc-4966-41e2-b425-6027d699ac9e service nova] Acquired lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:59:26 user nova-compute[72409]: DEBUG nova.network.neutron [req-79296836-f617-4060-81b3-24400d496379 req-580327cc-4966-41e2-b425-6027d699ac9e service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Refreshing network info cache for port d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:59:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:28 user nova-compute[72409]: INFO nova.compute.manager [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Shelving
Aug 09 22:59:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-79296836-f617-4060-81b3-24400d496379 req-580327cc-4966-41e2-b425-6027d699ac9e service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updated VIF entry in instance network info cache for port d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-79296836-f617-4060-81b3-24400d496379 req-580327cc-4966-41e2-b425-6027d699ac9e service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updating instance_info_cache with network_info: [{"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-79296836-f617-4060-81b3-24400d496379 req-580327cc-4966-41e2-b425-6027d699ac9e service nova] Releasing lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-cfa9b07a-2a9a-467b-9395-a5619c37eaa6 req-a651a971-66c5-4d95-8eb6-c0b15e8035a7 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-vif-unplugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cfa9b07a-2a9a-467b-9395-a5619c37eaa6 req-a651a971-66c5-4d95-8eb6-c0b15e8035a7 service nova] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cfa9b07a-2a9a-467b-9395-a5619c37eaa6 req-a651a971-66c5-4d95-8eb6-c0b15e8035a7 service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cfa9b07a-2a9a-467b-9395-a5619c37eaa6 req-a651a971-66c5-4d95-8eb6-c0b15e8035a7 service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-cfa9b07a-2a9a-467b-9395-a5619c37eaa6 req-a651a971-66c5-4d95-8eb6-c0b15e8035a7 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] No waiting events found dispatching network-vif-unplugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:28 user nova-compute[72409]: WARNING nova.compute.manager [req-cfa9b07a-2a9a-467b-9395-a5619c37eaa6 req-a651a971-66c5-4d95-8eb6-c0b15e8035a7 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received unexpected event network-vif-unplugged-a80bd290-a75e-4702-b917-3319bee30a60 for instance with vm_state active and task_state shelving.
Aug 09 22:59:28 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Instance destroyed successfully.
Aug 09 22:59:28 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Beginning cold snapshot process
Aug 09 22:59:29 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 22:59:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk /opt/stack/data/nova/instances/snapshots/tmph_23kjke/99de7d9c23fe4b2c8a4e820719151dde {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk /opt/stack/data/nova/instances/snapshots/tmph_23kjke/99de7d9c23fe4b2c8a4e820719151dde" returned: 0 in 1.207s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:30 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Snapshot extracted, beginning image upload
Aug 09 22:59:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] No waiting events found dispatching network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:30 user nova-compute[72409]: WARNING nova.compute.manager [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received unexpected event network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 22:59:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-changed-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Refreshing instance network info cache due to event network-changed-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:59:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] Acquiring lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:59:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] Acquired lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:59:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Refreshing network info cache for port d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:59:31 user nova-compute[72409]: DEBUG nova.network.neutron [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updated VIF entry in instance network info cache for port d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:59:31 user nova-compute[72409]: DEBUG nova.network.neutron [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updating instance_info_cache with network_info: [{"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:59:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87879ca6-301f-4639-887b-555d12e83451 req-ca110a63-b651-4f99-9427-6b2f5fc69873 service nova] Releasing lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:59:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:32 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621957.6322203, 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:59:32 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] VM Stopped (Lifecycle Event)
Aug 09 22:59:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e7fed69c-2d2e-4836-ad1d-bf0050412879 None None] [instance: 0c9c767c-ca61-4ed3-b0e9-6e039dd86c78] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:59:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Snapshot image upload complete
Aug 09 22:59:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:59:32 user nova-compute[72409]: INFO nova.compute.manager [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Shelve offloading
Aug 09 22:59:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Instance destroyed successfully.
Aug 09 22:59:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:59:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:59:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquired lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:59:32 user nova-compute[72409]: DEBUG nova.network.neutron [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:59:33 user nova-compute[72409]: DEBUG nova.network.neutron [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updating instance_info_cache with network_info: [{"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:59:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Releasing lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:59:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Instance destroyed successfully.
Aug 09 22:59:34 user nova-compute[72409]: DEBUG nova.objects.instance [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'resources' on Instance uuid 913c4e3b-f449-45fa-9ca7-3cef4b982679 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1373843419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1373843419',id=25,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC1hhBxaz7viONyIT9RsHBrWO2Zdg8jzhxEhHD5WrF5eHR/YWIq5aFc8ycg7RekfFI/PdlohcnFbJxcfXXvCNSOh0Z5bDeIh5g1vM6vUGxs6yI1wQi6EYyidFxqU62AkA==',key_name='tempest-keypair-656104974',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='894e6764aa794ff29ce4bc213a7def7d',ramdisk_id='',reservation_id='r-0g99dck8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-723310053',owner_user_name='tempest-AttachVolumeShelveTestJSON-723310053-project-member',shelved_at='2023-08-09T22:59:32.824646',shelved_host='user',shelved_image_id='4c55318f-277e-4268-b40a-d8349ba092d6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:59:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce008676a8de41b8b2ffe79ab31462df',uuid=913c4e3b-f449-45fa-9ca7-3cef4b982679,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converting VIF {"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG os_vif [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa80bd290-a7, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG nova.compute.manager [req-c617fa6b-bb1c-4d8f-af0f-26e13f63ca3c req-055e0667-e39b-43be-972e-7be756ce294d service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-changed-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG nova.compute.manager [req-c617fa6b-bb1c-4d8f-af0f-26e13f63ca3c req-055e0667-e39b-43be-972e-7be756ce294d service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Refreshing instance network info cache due to event network-changed-a80bd290-a75e-4702-b917-3319bee30a60. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c617fa6b-bb1c-4d8f-af0f-26e13f63ca3c req-055e0667-e39b-43be-972e-7be756ce294d service nova] Acquiring lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c617fa6b-bb1c-4d8f-af0f-26e13f63ca3c req-055e0667-e39b-43be-972e-7be756ce294d service nova] Acquired lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG nova.network.neutron [req-c617fa6b-bb1c-4d8f-af0f-26e13f63ca3c req-055e0667-e39b-43be-972e-7be756ce294d service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Refreshing network info cache for port a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:59:34 user nova-compute[72409]: INFO os_vif [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7')
Aug 09 22:59:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Deleting instance files /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679_del
Aug 09 22:59:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Deletion of /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679_del complete
Aug 09 22:59:34 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Deleted allocations for instance 913c4e3b-f449-45fa-9ca7-3cef4b982679
Aug 09 22:59:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG nova.objects.instance [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'numa_topology' on Instance uuid 913c4e3b-f449-45fa-9ca7-3cef4b982679 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG nova.network.neutron [req-c617fa6b-bb1c-4d8f-af0f-26e13f63ca3c req-055e0667-e39b-43be-972e-7be756ce294d service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updated VIF entry in instance network info cache for port a80bd290-a75e-4702-b917-3319bee30a60. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG nova.network.neutron [req-c617fa6b-bb1c-4d8f-af0f-26e13f63ca3c req-055e0667-e39b-43be-972e-7be756ce294d service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updating instance_info_cache with network_info: [{"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa80bd290-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c617fa6b-bb1c-4d8f-af0f-26e13f63ca3c req-055e0667-e39b-43be-972e-7be756ce294d service nova] Releasing lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:59:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-be0a97dd-4b5f-458e-85bc-6a37ddeb4d04 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.832s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:35 user nova-compute[72409]: INFO nova.compute.manager [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Rebooting instance
Aug 09 22:59:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 22:59:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquired lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 22:59:35 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621961.1944714, c513e397-28f7-4d93-8487-257becbef9d3 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:59:36 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] VM Stopped (Lifecycle Event)
Aug 09 22:59:36 user nova-compute[72409]: DEBUG nova.compute.manager [None req-6b3a6be2-be6e-4aec-b900-9ae3dc6ac863 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG nova.compute.manager [None req-6b3a6be2-be6e-4aec-b900-9ae3dc6ac863 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:59:36 user nova-compute[72409]: INFO nova.compute.manager [None req-6b3a6be2-be6e-4aec-b900-9ae3dc6ac863 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 22:59:36 user nova-compute[72409]: DEBUG nova.network.neutron [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updating instance_info_cache with network_info: [{"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Releasing lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-1410ffb2-96dd-40e1-a3b3-ddda49ae950d req-f2891b0a-c34b-46fa-ae1c-2ee0018b5134 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-vif-unplugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1410ffb2-96dd-40e1-a3b3-ddda49ae950d req-f2891b0a-c34b-46fa-ae1c-2ee0018b5134 service nova] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1410ffb2-96dd-40e1-a3b3-ddda49ae950d req-f2891b0a-c34b-46fa-ae1c-2ee0018b5134 service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1410ffb2-96dd-40e1-a3b3-ddda49ae950d req-f2891b0a-c34b-46fa-ae1c-2ee0018b5134 service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-1410ffb2-96dd-40e1-a3b3-ddda49ae950d req-f2891b0a-c34b-46fa-ae1c-2ee0018b5134 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] No waiting events found dispatching network-vif-unplugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:36 user nova-compute[72409]: WARNING nova.compute.manager [req-1410ffb2-96dd-40e1-a3b3-ddda49ae950d req-f2891b0a-c34b-46fa-ae1c-2ee0018b5134 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received unexpected event network-vif-unplugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d for instance with vm_state active and task_state reboot_started_hard.
Aug 09 22:59:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:37 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Instance destroyed successfully.
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'resources' on Instance uuid 65d39a39-3616-40db-906b-d4327e1d63c5 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412508005',display_name='tempest-TestMinimumBasicScenario-server-1412508005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412508005',id=23,image_ref='c98b41c3-c55f-4611-b915-f71a20d77fa8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHNfX9MWZkMyzioX/sWVa4s+rtfVlh+5vlMYHbjyIYluYUUgKRn1OlJBpE2A4bNlZRpcJprB0f1Qwc07KLZ2pODQGZBILXeMZIeBIyMkusp4+aJ6bbTIINp1QC0dSUmgQ==',key_name='tempest-TestMinimumBasicScenario-1519007605',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:57:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fb0e0790757422da3f43722e4bd554e',ramdisk_id='',reservation_id='r-uxli3rx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c98b41c3-c55f-4611-b915-f71a20d77fa8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1632899528',owner_user_name='tempest-TestMinimumBasicScenario-1632899528-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:59:37Z,user_data=None,user_id='8411ad4a2fdd412783da8516d860cccb',uuid=65d39a39-3616-40db-906b-d4327e1d63c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converting VIF {"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_vif [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8fb0a70-5e, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:59:37 user nova-compute[72409]: INFO os_vif [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e')
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZmAoLng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:59:37 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf1cafd-110f-442e-8bb5-fec1ab9f6409]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[88012f28-3692-46b7-a9a4-a6d0837bcb11]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:37 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:37 user nova-compute[72409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:37 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:37 user nova-compute[72409]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e9434a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b38d8-db7c-436c-ba78-2210da0309fa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[757ceceb-2cd6-4361-9b51-bb7af873cc14]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a47930-d379-41c6-91b1-80648a787e46]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[32acd466-f281-46b4-ab38-031d80427b3b]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e027100-dc61-4bfe-b061-f687b0b9f39a]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d9574b-6224-478c-81a2-29852ddcea0b]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260]
Aug 09 22:59:37 user nova-compute[72409]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260] successful.
Aug 09 22:59:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab74adba-efdf-4aa3-a3a8-8d827bd890b0]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] <== disconnect_volume: return (288ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Start _get_guest_xml network_info=[{"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c98b41c3-c55f-4611-b915-f71a20d77fa8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': 'c98b41c3-c55f-4611-b915-f71a20d77fa8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZmAoLng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '65d39a39-3616-40db-906b-d4327e1d63c5', 'attached_at': '', 'detached_at': '', 'volume_id': '23978613-d1bf-48c8-b5e7-83727d93e2cd', 'serial': '23978613-d1bf-48c8-b5e7-83727d93e2cd'}, 'mount_device': '/dev/vdb', 'attachment_id': '243add46-7743-47d2-85bb-9baa75fb9499', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:59:37 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:59:37 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c98b41c3-c55f-4611-b915-f71a20d77fa8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'vcpu_model' on Instance uuid 65d39a39-3616-40db-906b-d4327e1d63c5 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZmAoLng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:59:37 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:59:37 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:59:37 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[847ec485-1181-4061-8a56-b5e685211288]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:59:37 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2b3ec7-f027-416c-b43e-275242cc5788]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd] added
Aug 09 22:59:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bb7720-1a89-4869-b5de-683cca47a2e9]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ac8dcb-0b4e-47c8-8197-4562247f37c2]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZmAoLng {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aZmAoLng" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce22c00-9038-4774-a7ff-0ff603962dbf]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aZmAoLng'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8670a19-eac1-4b25-bef5-e100531ad043]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e353b0-06e7-4328-83f7-a50ab3e658af]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:38 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:38 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:38 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:38 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee3629d-fe8c-4f85-bdeb-28f062cfc324]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260]
Aug 09 22:59:38 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260] successful.
Aug 09 22:59:38 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c27493-26b1-42f9-978a-d848209a0ed1]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce49fd51-a7dc-474d-a56e-c65a204a9d02]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:38 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:38 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:38 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:38 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:38 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:38 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b919c030-8c83-457c-b317-51399a02cdeb]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZmAoLng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-4493f33b-11d4-4e5b-9220-000e3fb860c0 req-6c750337-ece8-46a3-aa26-c7ead7ab16a1 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4493f33b-11d4-4e5b-9220-000e3fb860c0 req-6c750337-ece8-46a3-aa26-c7ead7ab16a1 service nova] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4493f33b-11d4-4e5b-9220-000e3fb860c0 req-6c750337-ece8-46a3-aa26-c7ead7ab16a1 service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4493f33b-11d4-4e5b-9220-000e3fb860c0 req-6c750337-ece8-46a3-aa26-c7ead7ab16a1 service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-4493f33b-11d4-4e5b-9220-000e3fb860c0 req-6c750337-ece8-46a3-aa26-c7ead7ab16a1 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] No waiting events found dispatching network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:38 user nova-compute[72409]: WARNING nova.compute.manager [req-4493f33b-11d4-4e5b-9220-000e3fb860c0 req-6c750337-ece8-46a3-aa26-c7ead7ab16a1 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received unexpected event network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d for instance with vm_state active and task_state reboot_started_hard.
Aug 09 22:59:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23864363365643063', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864363365643063', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412508005',display_name='tempest-TestMinimumBasicScenario-server-1412508005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412508005',id=23,image_ref='c98b41c3-c55f-4611-b915-f71a20d77fa8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHNfX9MWZkMyzioX/sWVa4s+rtfVlh+5vlMYHbjyIYluYUUgKRn1OlJBpE2A4bNlZRpcJprB0f1Qwc07KLZ2pODQGZBILXeMZIeBIyMkusp4+aJ6bbTIINp1QC0dSUmgQ==',key_name='tempest-TestMinimumBasicScenario-1519007605',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:57:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fb0e0790757422da3f43722e4bd554e',ramdisk_id='',reservation_id='r-uxli3rx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c98b41c3-c55f-4611-b915-f71a20d77fa8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1632899528',owner_user_name='tempest-TestMinimumBasicScenario-1632899528-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:59:37Z,user_data=None,user_id='8411ad4a2fdd412783da8516d860cccb',uuid=65d39a39-3616-40db-906b-d4327e1d63c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converting VIF {"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'pci_devices' on Instance uuid 65d39a39-3616-40db-906b-d4327e1d63c5 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:59:39 user nova-compute[72409]:   <uuid>65d39a39-3616-40db-906b-d4327e1d63c5</uuid>
Aug 09 22:59:39 user nova-compute[72409]:   <name>instance-00000017</name>
Aug 09 22:59:39 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 22:59:39 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:59:39 user nova-compute[72409]:   <metadata>
Aug 09 22:59:39 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:59:39 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:59:39 user nova-compute[72409]:       <nova:name>tempest-TestMinimumBasicScenario-server-1412508005</nova:name>
Aug 09 22:59:39 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:59:37</nova:creationTime>
Aug 09 22:59:39 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 22:59:39 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 22:59:39 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 22:59:39 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:59:39 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:59:39 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:59:39 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:59:39 user nova-compute[72409]:       <nova:owner>
Aug 09 22:59:39 user nova-compute[72409]:         <nova:user uuid="8411ad4a2fdd412783da8516d860cccb">tempest-TestMinimumBasicScenario-1632899528-project-member</nova:user>
Aug 09 22:59:39 user nova-compute[72409]:         <nova:project uuid="2fb0e0790757422da3f43722e4bd554e">tempest-TestMinimumBasicScenario-1632899528</nova:project>
Aug 09 22:59:39 user nova-compute[72409]:       </nova:owner>
Aug 09 22:59:39 user nova-compute[72409]:       <nova:root type="image" uuid="c98b41c3-c55f-4611-b915-f71a20d77fa8"/>
Aug 09 22:59:39 user nova-compute[72409]:       <nova:ports>
Aug 09 22:59:39 user nova-compute[72409]:         <nova:port uuid="d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d">
Aug 09 22:59:39 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 22:59:39 user nova-compute[72409]:         </nova:port>
Aug 09 22:59:39 user nova-compute[72409]:       </nova:ports>
Aug 09 22:59:39 user nova-compute[72409]:     </nova:instance>
Aug 09 22:59:39 user nova-compute[72409]:   </metadata>
Aug 09 22:59:39 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:59:39 user nova-compute[72409]:     <system>
Aug 09 22:59:39 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:59:39 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:59:39 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:59:39 user nova-compute[72409]:       <entry name="serial">65d39a39-3616-40db-906b-d4327e1d63c5</entry>
Aug 09 22:59:39 user nova-compute[72409]:       <entry name="uuid">65d39a39-3616-40db-906b-d4327e1d63c5</entry>
Aug 09 22:59:39 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:59:39 user nova-compute[72409]:     </system>
Aug 09 22:59:39 user nova-compute[72409]:   </sysinfo>
Aug 09 22:59:39 user nova-compute[72409]:   <os>
Aug 09 22:59:39 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:59:39 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:59:39 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:59:39 user nova-compute[72409]:   </os>
Aug 09 22:59:39 user nova-compute[72409]:   <features>
Aug 09 22:59:39 user nova-compute[72409]:     <acpi/>
Aug 09 22:59:39 user nova-compute[72409]:     <apic/>
Aug 09 22:59:39 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:59:39 user nova-compute[72409]:   </features>
Aug 09 22:59:39 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:59:39 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:59:39 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:59:39 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:59:39 user nova-compute[72409]:   </clock>
Aug 09 22:59:39 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:59:39 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:59:39 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:59:39 user nova-compute[72409]:   </cpu>
Aug 09 22:59:39 user nova-compute[72409]:   <devices>
Aug 09 22:59:39 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:59:39 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:59:39 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk"/>
Aug 09 22:59:39 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:59:39 user nova-compute[72409]:     </disk>
Aug 09 22:59:39 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:59:39 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:59:39 user nova-compute[72409]:       <source dev="/dev/sdc"/>
Aug 09 22:59:39 user nova-compute[72409]:       <target dev="vdb" bus="virtio"/>
Aug 09 22:59:39 user nova-compute[72409]:       <serial>23978613-d1bf-48c8-b5e7-83727d93e2cd</serial>
Aug 09 22:59:39 user nova-compute[72409]:     </disk>
Aug 09 22:59:39 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:59:39 user nova-compute[72409]:       <mac address="fa:16:3e:04:8a:27"/>
Aug 09 22:59:39 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:59:39 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:59:39 user nova-compute[72409]:       <target dev="tapd8fb0a70-5e"/>
Aug 09 22:59:39 user nova-compute[72409]:     </interface>
Aug 09 22:59:39 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:59:39 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/console.log" append="off"/>
Aug 09 22:59:39 user nova-compute[72409]:     </serial>
Aug 09 22:59:39 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:59:39 user nova-compute[72409]:     <video>
Aug 09 22:59:39 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:59:39 user nova-compute[72409]:     </video>
Aug 09 22:59:39 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:59:39 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:59:39 user nova-compute[72409]:     </rng>
Aug 09 22:59:39 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:59:39 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:59:39 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:59:39 user nova-compute[72409]:     </memballoon>
Aug 09 22:59:39 user nova-compute[72409]:   </devices>
Aug 09 22:59:39 user nova-compute[72409]: </domain>
Aug 09 22:59:39 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Starting finish_migration {{(pid=72409) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Instance directory exists: not creating {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 22:59:39 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Creating image(s)
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.objects.instance [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'trusted_certs' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'trusted_certs' on Instance uuid 65d39a39-3616-40db-906b-d4327e1d63c5 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk. size=21474836480 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7 --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk 21474836480 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk 21474836480" returned: 0 in 0.043s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Ensure instance console log exists: /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Start _get_guest_xml network_info=[{"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-372540247-network", "vif_mac": "fa:16:3e:26:c6:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqbIjKzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c513e397-28f7-4d93-8487-257becbef9d3', 'attached_at': '2023-08-09T22:59:39.000000', 'detached_at': '', 'volume_id': 'ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35', 'serial': 'ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'}, 'mount_device': '/dev/vdb', 'attachment_id': 'b098e57a-b335-4c43-997f-43b46cd6084f', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 22:59:39 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:59:39 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:46:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.objects.instance [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'vcpu_model' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Cannot resize image /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'migration_context' on Instance uuid 65d39a39-3616-40db-906b-d4327e1d63c5 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqbIjKzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:59:39 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:59:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:59:39 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 22:59:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 22:59:39 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412508005',display_name='tempest-TestMinimumBasicScenario-server-1412508005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412508005',id=23,image_ref='c98b41c3-c55f-4611-b915-f71a20d77fa8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHNfX9MWZkMyzioX/sWVa4s+rtfVlh+5vlMYHbjyIYluYUUgKRn1OlJBpE2A4bNlZRpcJprB0f1Qwc07KLZ2pODQGZBILXeMZIeBIyMkusp4+aJ6bbTIINp1QC0dSUmgQ==',key_name='tempest-TestMinimumBasicScenario-1519007605',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:57:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='2fb0e0790757422da3f43722e4bd554e',ramdisk_id='',reservation_id='r-uxli3rx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c98b41c3-c55f-4611-b915-f71a20d77fa8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1632899528',owner_user_name='tempest-TestMinimumBasicScenario-1632899528-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:59:37Z,user_data=None,user_id='8411ad4a2fdd412783da8516d860cccb',uuid=65d39a39-3616-40db-906b-d4327e1d63c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converting VIF {"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG os_vif [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8fb0a70-5e, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8fb0a70-5e, col_values=(('external_ids', {'iface-id': 'd8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:8a:27', 'vm-uuid': '65d39a39-3616-40db-906b-d4327e1d63c5'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ffb4db-cfc3-4eaa-a0da-6964de2451f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 22:59:39 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:39 user nova-compute[72409]: INFO os_vif [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e')
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5566794-9d83-4b2d-b7e1-8528cc3b7ff1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35] added
Aug 09 22:59:39 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d665c77d-6000-44cd-bdb4-96c11a72a301]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d2b027-2496-4adf-b105-0bc00d538487]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqbIjKzx {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqbIjKzx" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8f3636-3ee2-4914-84ff-7b4e17ad2e75]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RqbIjKzx'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf2e758-30ca-4133-a7ad-14f59eb12e9e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3524734e-c8be-4314-9cdf-c1e189ce1033]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:40 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:40 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:40 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:40 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c957bb94-de4a-4838-abab-64b853b991cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260]
Aug 09 22:59:40 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260] successful.
Aug 09 22:59:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf41b9f-ae73-4b16-b306-3559a233ae08]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79b4e83-de7f-4698-b8fd-12b8c70efb48]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:40 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:40 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:40 user nova-compute[72409]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 22:59:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 22:59:40 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 22:59:40 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 22:59:40 user nova-compute[72409]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 22:59:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[698d4877-f932-4111-ad96-cd9b0eee0dbe]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 22:59:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqbIjKzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23863343064623135', 'path': '/dev/sde'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863343064623135', 'path': '/dev/sde'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2097419676',display_name='tempest-ServerActionsTestOtherB-server-2097419676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2097419676',id=19,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDelHCC8nFCHRTmFXWR19BOOB/f+NPR90u8i8YXxlReJTIRJmpJsKKUPRbCWzHe6UX+HR9F8ZTKdA6A0YGmKOztUWCiwbCDEi2c3eCmLXAc66rx+Q4ob5pL4kfTx6LhQUg==',key_name='tempest-keypair-351454578',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a302bac664904169ad012943400598db',ramdisk_id='',reservation_id='r-pfgn9xa9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-68548202',owner_user_name='tempest-ServerActionsTestOtherB-68548202-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:59:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d662607342934fb7babc31e155f5d915',uuid=c513e397-28f7-4d93-8487-257becbef9d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-372540247-network", "vif_mac": "fa:16:3e:26:c6:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converting VIF {"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-372540247-network", "vif_mac": "fa:16:3e:26:c6:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 22:59:41 user nova-compute[72409]:   <uuid>c513e397-28f7-4d93-8487-257becbef9d3</uuid>
Aug 09 22:59:41 user nova-compute[72409]:   <name>instance-00000013</name>
Aug 09 22:59:41 user nova-compute[72409]:   <memory>2097152</memory>
Aug 09 22:59:41 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 22:59:41 user nova-compute[72409]:   <metadata>
Aug 09 22:59:41 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 22:59:41 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 22:59:41 user nova-compute[72409]:       <nova:name>tempest-ServerActionsTestOtherB-server-2097419676</nova:name>
Aug 09 22:59:41 user nova-compute[72409]:       <nova:creationTime>2023-08-09 22:59:39</nova:creationTime>
Aug 09 22:59:41 user nova-compute[72409]:       <nova:flavor name="m1.small">
Aug 09 22:59:41 user nova-compute[72409]:         <nova:memory>2048</nova:memory>
Aug 09 22:59:41 user nova-compute[72409]:         <nova:disk>20</nova:disk>
Aug 09 22:59:41 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 22:59:41 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 22:59:41 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 22:59:41 user nova-compute[72409]:       </nova:flavor>
Aug 09 22:59:41 user nova-compute[72409]:       <nova:owner>
Aug 09 22:59:41 user nova-compute[72409]:         <nova:user uuid="d662607342934fb7babc31e155f5d915">tempest-ServerActionsTestOtherB-68548202-project-member</nova:user>
Aug 09 22:59:41 user nova-compute[72409]:         <nova:project uuid="a302bac664904169ad012943400598db">tempest-ServerActionsTestOtherB-68548202</nova:project>
Aug 09 22:59:41 user nova-compute[72409]:       </nova:owner>
Aug 09 22:59:41 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 22:59:41 user nova-compute[72409]:       <nova:ports>
Aug 09 22:59:41 user nova-compute[72409]:         <nova:port uuid="6afaf787-02f9-400f-b7a9-b0aa4df58939">
Aug 09 22:59:41 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 22:59:41 user nova-compute[72409]:         </nova:port>
Aug 09 22:59:41 user nova-compute[72409]:       </nova:ports>
Aug 09 22:59:41 user nova-compute[72409]:     </nova:instance>
Aug 09 22:59:41 user nova-compute[72409]:   </metadata>
Aug 09 22:59:41 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 22:59:41 user nova-compute[72409]:     <system>
Aug 09 22:59:41 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 22:59:41 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 22:59:41 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 22:59:41 user nova-compute[72409]:       <entry name="serial">c513e397-28f7-4d93-8487-257becbef9d3</entry>
Aug 09 22:59:41 user nova-compute[72409]:       <entry name="uuid">c513e397-28f7-4d93-8487-257becbef9d3</entry>
Aug 09 22:59:41 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 22:59:41 user nova-compute[72409]:     </system>
Aug 09 22:59:41 user nova-compute[72409]:   </sysinfo>
Aug 09 22:59:41 user nova-compute[72409]:   <os>
Aug 09 22:59:41 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 22:59:41 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 22:59:41 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 22:59:41 user nova-compute[72409]:   </os>
Aug 09 22:59:41 user nova-compute[72409]:   <features>
Aug 09 22:59:41 user nova-compute[72409]:     <acpi/>
Aug 09 22:59:41 user nova-compute[72409]:     <apic/>
Aug 09 22:59:41 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 22:59:41 user nova-compute[72409]:   </features>
Aug 09 22:59:41 user nova-compute[72409]:   <clock offset="utc">
Aug 09 22:59:41 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 22:59:41 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 22:59:41 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 22:59:41 user nova-compute[72409]:   </clock>
Aug 09 22:59:41 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 22:59:41 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 22:59:41 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 22:59:41 user nova-compute[72409]:   </cpu>
Aug 09 22:59:41 user nova-compute[72409]:   <devices>
Aug 09 22:59:41 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 22:59:41 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 22:59:41 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk"/>
Aug 09 22:59:41 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 22:59:41 user nova-compute[72409]:     </disk>
Aug 09 22:59:41 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 22:59:41 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 22:59:41 user nova-compute[72409]:       <source dev="/dev/sde"/>
Aug 09 22:59:41 user nova-compute[72409]:       <target dev="vdb" bus="virtio"/>
Aug 09 22:59:41 user nova-compute[72409]:       <serial>ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35</serial>
Aug 09 22:59:41 user nova-compute[72409]:     </disk>
Aug 09 22:59:41 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 22:59:41 user nova-compute[72409]:       <mac address="fa:16:3e:26:c6:8e"/>
Aug 09 22:59:41 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:59:41 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 22:59:41 user nova-compute[72409]:       <target dev="tap6afaf787-02"/>
Aug 09 22:59:41 user nova-compute[72409]:     </interface>
Aug 09 22:59:41 user nova-compute[72409]:     <serial type="pty">
Aug 09 22:59:41 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/console.log" append="off"/>
Aug 09 22:59:41 user nova-compute[72409]:     </serial>
Aug 09 22:59:41 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 22:59:41 user nova-compute[72409]:     <video>
Aug 09 22:59:41 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 22:59:41 user nova-compute[72409]:     </video>
Aug 09 22:59:41 user nova-compute[72409]:     <rng model="virtio">
Aug 09 22:59:41 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 22:59:41 user nova-compute[72409]:     </rng>
Aug 09 22:59:41 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 22:59:41 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 22:59:41 user nova-compute[72409]:       <stats period="10"/>
Aug 09 22:59:41 user nova-compute[72409]:     </memballoon>
Aug 09 22:59:41 user nova-compute[72409]:   </devices>
Aug 09 22:59:41 user nova-compute[72409]: </domain>
Aug 09 22:59:41 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2097419676',display_name='tempest-ServerActionsTestOtherB-server-2097419676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2097419676',id=19,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDelHCC8nFCHRTmFXWR19BOOB/f+NPR90u8i8YXxlReJTIRJmpJsKKUPRbCWzHe6UX+HR9F8ZTKdA6A0YGmKOztUWCiwbCDEi2c3eCmLXAc66rx+Q4ob5pL4kfTx6LhQUg==',key_name='tempest-keypair-351454578',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a302bac664904169ad012943400598db',ramdisk_id='',reservation_id='r-pfgn9xa9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-68548202',owner_user_name='tempest-ServerActionsTestOtherB-68548202-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:59:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d662607342934fb7babc31e155f5d915',uuid=c513e397-28f7-4d93-8487-257becbef9d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-372540247-network", "vif_mac": "fa:16:3e:26:c6:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converting VIF {"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-372540247-network", "vif_mac": "fa:16:3e:26:c6:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG os_vif [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6afaf787-02, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6afaf787-02, col_values=(('external_ids', {'iface-id': '6afaf787-02f9-400f-b7a9-b0aa4df58939', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:c6:8e', 'vm-uuid': 'c513e397-28f7-4d93-8487-257becbef9d3'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:41 user nova-compute[72409]: INFO os_vif [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02')
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] No VIF found with MAC fa:16:3e:26:c6:8e, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-acf27f89-37cf-41ec-80fc-748f0bdf8689 req-cba11dc6-bda1-41bb-8ae3-8544699b37bb service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-acf27f89-37cf-41ec-80fc-748f0bdf8689 req-cba11dc6-bda1-41bb-8ae3-8544699b37bb service nova] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-acf27f89-37cf-41ec-80fc-748f0bdf8689 req-cba11dc6-bda1-41bb-8ae3-8544699b37bb service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-acf27f89-37cf-41ec-80fc-748f0bdf8689 req-cba11dc6-bda1-41bb-8ae3-8544699b37bb service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-acf27f89-37cf-41ec-80fc-748f0bdf8689 req-cba11dc6-bda1-41bb-8ae3-8544699b37bb service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] No waiting events found dispatching network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:41 user nova-compute[72409]: WARNING nova.compute.manager [req-acf27f89-37cf-41ec-80fc-748f0bdf8689 req-cba11dc6-bda1-41bb-8ae3-8544699b37bb service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received unexpected event network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d for instance with vm_state active and task_state reboot_started_hard.
Aug 09 22:59:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-22ccf1f7-516d-4687-8f11-7e7f16b6a226 req-d334c0f4-b4ab-499d-bb6f-1273d02d2339 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-22ccf1f7-516d-4687-8f11-7e7f16b6a226 req-d334c0f4-b4ab-499d-bb6f-1273d02d2339 service nova] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-22ccf1f7-516d-4687-8f11-7e7f16b6a226 req-d334c0f4-b4ab-499d-bb6f-1273d02d2339 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-22ccf1f7-516d-4687-8f11-7e7f16b6a226 req-d334c0f4-b4ab-499d-bb6f-1273d02d2339 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-22ccf1f7-516d-4687-8f11-7e7f16b6a226 req-d334c0f4-b4ab-499d-bb6f-1273d02d2339 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] No waiting events found dispatching network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:43 user nova-compute[72409]: WARNING nova.compute.manager [req-22ccf1f7-516d-4687-8f11-7e7f16b6a226 req-d334c0f4-b4ab-499d-bb6f-1273d02d2339 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received unexpected event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 for instance with vm_state active and task_state resize_finish.
Aug 09 22:59:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-6848f665-6706-4349-b598-6444480cc4b7 req-30915c50-c082-4f80-b583-f6429d96f32a service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6848f665-6706-4349-b598-6444480cc4b7 req-30915c50-c082-4f80-b583-f6429d96f32a service nova] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6848f665-6706-4349-b598-6444480cc4b7 req-30915c50-c082-4f80-b583-f6429d96f32a service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6848f665-6706-4349-b598-6444480cc4b7 req-30915c50-c082-4f80-b583-f6429d96f32a service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-6848f665-6706-4349-b598-6444480cc4b7 req-30915c50-c082-4f80-b583-f6429d96f32a service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] No waiting events found dispatching network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:43 user nova-compute[72409]: WARNING nova.compute.manager [req-6848f665-6706-4349-b598-6444480cc4b7 req-30915c50-c082-4f80-b583-f6429d96f32a service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received unexpected event network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d for instance with vm_state active and task_state reboot_started_hard.
Aug 09 22:59:43 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621968.8867772, 913c4e3b-f449-45fa-9ca7-3cef4b982679 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:59:43 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] VM Stopped (Lifecycle Event)
Aug 09 22:59:43 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e1fb7650-2856-4a64-b0ef-5f2971e043a4 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:44 user nova-compute[72409]: INFO nova.compute.manager [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Terminating instance
Aug 09 22:59:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 22:59:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Removed pending event for 65d39a39-3616-40db-906b-d4327e1d63c5 due to event {{(pid=72409) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621985.254557, 65d39a39-3616-40db-906b-d4327e1d63c5 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:59:45 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] VM Resumed (Lifecycle Event)
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:59:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Instance rebooted successfully.
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:59:45 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621985.2628214, 65d39a39-3616-40db-906b-d4327e1d63c5 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:59:45 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] VM Started (Lifecycle Event)
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8de0e37f-b648-4cb4-8041-476bbb63be5c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.417s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Instance destroyed successfully.
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.objects.instance [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lazy-loading 'resources' on Instance uuid 3b3ff97a-c2d6-4a63-8150-cc22f5903fae {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1626907645',display_name='tempest-VolumesActionsTest-instance-1626907645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1626907645',id=26,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:58:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa953a0836e54254a4917555ccf838a1',ramdisk_id='',reservation_id='r-mp0u5vo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-24018393',owner_user_name='tempest-VolumesActionsTest-24018393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:58:02Z,user_data=None,user_id='8fa331e6178145b5b9a0d07a4b4a4d63',uuid=3b3ff97a-c2d6-4a63-8150-cc22f5903fae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "address": "fa:16:3e:ff:04:f3", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78fed8-8a", "ovs_interfaceid": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Converting VIF {"id": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "address": "fa:16:3e:ff:04:f3", "network": {"id": "68515068-05af-4472-9557-1581eabd1fd9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-210432430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa953a0836e54254a4917555ccf838a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc78fed8-8a", "ovs_interfaceid": "fc78fed8-8a1c-4619-90bd-46307b9dd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:f3,bridge_name='br-int',has_traffic_filtering=True,id=fc78fed8-8a1c-4619-90bd-46307b9dd406,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78fed8-8a') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG os_vif [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:f3,bridge_name='br-int',has_traffic_filtering=True,id=fc78fed8-8a1c-4619-90bd-46307b9dd406,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78fed8-8a') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc78fed8-8a, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:59:45 user nova-compute[72409]: INFO os_vif [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:04:f3,bridge_name='br-int',has_traffic_filtering=True,id=fc78fed8-8a1c-4619-90bd-46307b9dd406,network=Network(68515068-05af-4472-9557-1581eabd1fd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc78fed8-8a')
Aug 09 22:59:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Deleting instance files /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae_del
Aug 09 22:59:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Deletion of /opt/stack/data/nova/instances/3b3ff97a-c2d6-4a63-8150-cc22f5903fae_del complete
Aug 09 22:59:45 user nova-compute[72409]: INFO nova.compute.manager [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 22:59:45 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] No waiting events found dispatching network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:45 user nova-compute[72409]: WARNING nova.compute.manager [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received unexpected event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 for instance with vm_state active and task_state resize_finish.
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Received event network-vif-unplugged-fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] Acquiring lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] No waiting events found dispatching network-vif-unplugged-fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Received event network-vif-unplugged-fc78fed8-8a1c-4619-90bd-46307b9dd406 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Received event network-vif-plugged-fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] Acquiring lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] No waiting events found dispatching network-vif-plugged-fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 22:59:45 user nova-compute[72409]: WARNING nova.compute.manager [req-20fdd950-f070-45f6-922f-e029fbe016b2 req-8681379f-d789-4cda-924f-9c8aa6dd08bc service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Received unexpected event network-vif-plugged-fc78fed8-8a1c-4619-90bd-46307b9dd406 for instance with vm_state active and task_state deleting.
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621985.9228437, c513e397-28f7-4d93-8487-257becbef9d3 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:59:45 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] VM Resumed (Lifecycle Event)
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 22:59:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Instance running successfully.
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Failed to set time: agent not configured {{(pid=72409) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-02b45a94-567b-46d0-899a-6a2362c579da tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] finish_migration finished successfully. {{(pid=72409) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:59:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:59:46 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 22:59:46 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691621985.9260793, c513e397-28f7-4d93-8487-257becbef9d3 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 22:59:46 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] VM Started (Lifecycle Event)
Aug 09 22:59:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 22:59:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 22:59:46 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 22:59:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:46 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 22:59:46 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Took 0.94 seconds to deallocate network for instance.
Aug 09 22:59:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:47 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:59:47 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:59:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:47 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Deleted allocations for instance 3b3ff97a-c2d6-4a63-8150-cc22f5903fae
Aug 09 22:59:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-899deee6-c344-42aa-b2ba-e2ff4f1304e9 tempest-VolumesActionsTest-24018393 tempest-VolumesActionsTest-24018393-project-member] Lock "3b3ff97a-c2d6-4a63-8150-cc22f5903fae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.399s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:47 user nova-compute[72409]: DEBUG nova.compute.manager [req-17e11bcb-f327-48be-831e-b7b5be7f7fb0 req-7ea4f28d-7a9f-4dcd-9c67-bbafc2807107 service nova] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Received event network-vif-deleted-fc78fed8-8a1c-4619-90bd-46307b9dd406 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 22:59:48 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:59:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:52 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:59:52 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:59:53 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:59:54 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:59:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 22:59:55 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:59:55 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 22:59:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 22:59:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:59:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:59:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 22:59:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 22:59:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:59:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "66750137-9d3c-476b-b21b-10032ab3d55d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "66750137-9d3c-476b-b21b-10032ab3d55d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG nova.compute.manager [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 22:59:58 user nova-compute[72409]: INFO nova.compute.claims [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Claim successful on node user
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:58 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 22:59:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.708s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 22:59:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 22:59:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 22:59:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 22:59:59 user nova-compute[72409]: DEBUG nova.network.neutron [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 22:59:59 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 22:59:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 22:59:59 user nova-compute[72409]: INFO nova.virt.block_device [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Booting with volume bc0dff38-7586-497d-84f5-6de5d3a113be at /dev/vda
Aug 09 22:59:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 22:59:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 22:59:59 user nova-compute[72409]: DEBUG os_brick.utils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 22:59:59 user nova-compute[72409]: DEBUG nova.policy [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd5e2f13e0a448e836dd8684b889a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d29522bd16460eb1edc9fb7918111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 22:59:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:00 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:00:00 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7584MB free_disk=25.28384780883789GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[355e7325-d146-4b8f-8fc5-6104df357dd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3151ff63-c9dc-4baf-b737-f69d7fb500d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3387d088-aa11-4bec-8493-8eed68dc2e9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbb8a60-947b-4ca6-b058-5d0d6e640735]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Applying migration context for instance c513e397-28f7-4d93-8487-257becbef9d3 as it has an incoming, in-progress migration 892604ee-5dbb-4bea-9fa5-8c96ad738b30. Migration status is finished {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 23:00:00 user nova-compute[72409]: INFO nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating resource usage from migration 892604ee-5dbb-4bea-9fa5-8c96ad738b30
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:00:00 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30b6598-5981-486a-83d0-8e742943d33e]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG os_brick.utils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Updating existing volume attachment record: 4c9f0ec2-0f9c-40a5-b9b6-8bc70ce6adf4 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5b7906a3-e02b-49a3-9a56-fc34a8730238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c17c9b77-8e04-432c-9634-c4bee2eb8889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 6540903a-e102-40b3-833b-1ec5031c6d82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 65d39a39-3616-40db-906b-d4327e1d63c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Migration 892604ee-5dbb-4bea-9fa5-8c96ad738b30 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c513e397-28f7-4d93-8487-257becbef9d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 66750137-9d3c-476b-b21b-10032ab3d55d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691621985.5599, 3b3ff97a-c2d6-4a63-8150-cc22f5903fae => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:00:00 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] VM Stopped (Lifecycle Event)
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f2eab853-bbde-4fa7-8eaa-1beb6185380f None None] [instance: 3b3ff97a-c2d6-4a63-8150-cc22f5903fae] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:00 user nova-compute[72409]: DEBUG nova.network.neutron [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Successfully created port: 1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Skipping network cache update for instance because it is Building. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.network.neutron [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Successfully updated port: 1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 935c4677-a511-4b0e-aef3-57bc036220ab {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "refresh_cache-66750137-9d3c-476b-b21b-10032ab3d55d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquired lock "refresh_cache-66750137-9d3c-476b-b21b-10032ab3d55d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.network.neutron [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-a204c510-41ea-4f31-b5ed-faa1888f268e req-b0798f50-4c72-4506-8657-65818fa353ef service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Received event network-changed-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-a204c510-41ea-4f31-b5ed-faa1888f268e req-b0798f50-4c72-4506-8657-65818fa353ef service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Refreshing instance network info cache due to event network-changed-1ad0ad00-6090-4417-80ed-1a3fb46e6c83. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a204c510-41ea-4f31-b5ed-faa1888f268e req-b0798f50-4c72-4506-8657-65818fa353ef service nova] Acquiring lock "refresh_cache-66750137-9d3c-476b-b21b-10032ab3d55d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.network.neutron [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.network.neutron [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Updating instance_info_cache with network_info: [{"id": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "address": "fa:16:3e:a3:31:62", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad0ad00-60", "ovs_interfaceid": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Releasing lock "refresh_cache-66750137-9d3c-476b-b21b-10032ab3d55d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Instance network_info: |[{"id": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "address": "fa:16:3e:a3:31:62", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad0ad00-60", "ovs_interfaceid": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a204c510-41ea-4f31-b5ed-faa1888f268e req-b0798f50-4c72-4506-8657-65818fa353ef service nova] Acquired lock "refresh_cache-66750137-9d3c-476b-b21b-10032ab3d55d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:00:01 user nova-compute[72409]: DEBUG nova.network.neutron [req-a204c510-41ea-4f31-b5ed-faa1888f268e req-b0798f50-4c72-4506-8657-65818fa353ef service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Refreshing network info cache for port 1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:00:02 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Updating instance_info_cache with network_info: [{"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:00:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-935c4677-a511-4b0e-aef3-57bc036220ab" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:00:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:00:02 user nova-compute[72409]: DEBUG nova.network.neutron [req-a204c510-41ea-4f31-b5ed-faa1888f268e req-b0798f50-4c72-4506-8657-65818fa353ef service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Updated VIF entry in instance network info cache for port 1ad0ad00-6090-4417-80ed-1a3fb46e6c83. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:00:02 user nova-compute[72409]: DEBUG nova.network.neutron [req-a204c510-41ea-4f31-b5ed-faa1888f268e req-b0798f50-4c72-4506-8657-65818fa353ef service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Updating instance_info_cache with network_info: [{"id": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "address": "fa:16:3e:a3:31:62", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad0ad00-60", "ovs_interfaceid": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:00:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a204c510-41ea-4f31-b5ed-faa1888f268e req-b0798f50-4c72-4506-8657-65818fa353ef service nova] Releasing lock "refresh_cache-66750137-9d3c-476b-b21b-10032ab3d55d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:00:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:00:09 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Creating image(s)
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Ensure instance console log exists: /opt/stack/data/nova/instances/66750137-9d3c-476b-b21b-10032ab3d55d/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Start _get_guest_xml network_info=[{"id": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "address": "fa:16:3e:a3:31:62", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad0ad00-60", "ovs_interfaceid": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXZELpxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66750137-9d3c-476b-b21b-10032ab3d55d', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc0dff38-7586-497d-84f5-6de5d3a113be', 'serial': 'bc0dff38-7586-497d-84f5-6de5d3a113be'}, 'mount_device': '/dev/vda', 'attachment_id': '4c9f0ec2-0f9c-40a5-b9b6-8bc70ce6adf4', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:00:09 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:00:09 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXZELpxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:00:09 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:00:09 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:00:09 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c78901-a661-4aa2-9284-a3f98d7bd2bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:00:09 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdc1505-bb49-40a0-9052-e873a72591de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be] added
Aug 09 23:00:09 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb892d3-56e5-43e1-b9b0-f762d2c07b29]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc202ba-71b3-4e53-ab21-adfcd1b371f7]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXZELpxH {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXZELpxH" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ce9c7d-4333-48f7-ad41-73c7b14d1ded]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NXZELpxH'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[10581f04-4b0f-432b-a310-5b01526f5f25]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba5a34e-d253-41c6-acb8-3b27f38aa294]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:00:09 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:00:09 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a8c76d-27a5-4eb2-b0da-544cc21ba97f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be, portal: 172.16.0.220,3260]
Aug 09 23:00:09 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be, portal: 172.16.0.220,3260] successful.
Aug 09 23:00:09 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9138ffa8-5f70-418f-9ca7-0cdb051e1284]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd56d639-e563-4032-8f26-8cf677496f14]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:00:09 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:00:09 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:00:09 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0146a43-538a-4d11-b1cc-b4f9bfb10eb7]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:00:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXZELpxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26630303235666135', 'path': '/dev/sdf'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630303235666135', 'path': '/dev/sdf'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1341110089',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1341110089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1341110089',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK/hff2gw3r3ebPo5709PN+l9TEdCS3/+SPkoxsUa894NCFc/m4rcEOkzrjyZV5Y8ODUSMuMu76pNcC1+pmGKqfQ7naTeXsdRo0xdN5+IYrRrCmd/CQQJq9cHTVI8ecTg==',key_name='tempest-keypair-1532149728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-trc7six2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:59:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=66750137-9d3c-476b-b21b-10032ab3d55d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "address": "fa:16:3e:a3:31:62", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad0ad00-60", "ovs_interfaceid": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "address": "fa:16:3e:a3:31:62", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad0ad00-60", "ovs_interfaceid": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:31:62,bridge_name='br-int',has_traffic_filtering=True,id=1ad0ad00-6090-4417-80ed-1a3fb46e6c83,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad0ad00-60') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG nova.objects.instance [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lazy-loading 'pci_devices' on Instance uuid 66750137-9d3c-476b-b21b-10032ab3d55d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:00:10 user nova-compute[72409]:   <uuid>66750137-9d3c-476b-b21b-10032ab3d55d</uuid>
Aug 09 23:00:10 user nova-compute[72409]:   <name>instance-0000001b</name>
Aug 09 23:00:10 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:00:10 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:00:10 user nova-compute[72409]:   <metadata>
Aug 09 23:00:10 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:00:10 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:00:10 user nova-compute[72409]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1341110089</nova:name>
Aug 09 23:00:10 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:00:09</nova:creationTime>
Aug 09 23:00:10 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:00:10 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:00:10 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:00:10 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:00:10 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:00:10 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:00:10 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:00:10 user nova-compute[72409]:       <nova:owner>
Aug 09 23:00:10 user nova-compute[72409]:         <nova:user uuid="bcd5e2f13e0a448e836dd8684b889a70">tempest-TestVolumeBootPattern-431608932-project-member</nova:user>
Aug 09 23:00:10 user nova-compute[72409]:         <nova:project uuid="b6d29522bd16460eb1edc9fb7918111f">tempest-TestVolumeBootPattern-431608932</nova:project>
Aug 09 23:00:10 user nova-compute[72409]:       </nova:owner>
Aug 09 23:00:10 user nova-compute[72409]:       <nova:ports>
Aug 09 23:00:10 user nova-compute[72409]:         <nova:port uuid="1ad0ad00-6090-4417-80ed-1a3fb46e6c83">
Aug 09 23:00:10 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 23:00:10 user nova-compute[72409]:         </nova:port>
Aug 09 23:00:10 user nova-compute[72409]:       </nova:ports>
Aug 09 23:00:10 user nova-compute[72409]:     </nova:instance>
Aug 09 23:00:10 user nova-compute[72409]:   </metadata>
Aug 09 23:00:10 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:00:10 user nova-compute[72409]:     <system>
Aug 09 23:00:10 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:00:10 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:00:10 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:00:10 user nova-compute[72409]:       <entry name="serial">66750137-9d3c-476b-b21b-10032ab3d55d</entry>
Aug 09 23:00:10 user nova-compute[72409]:       <entry name="uuid">66750137-9d3c-476b-b21b-10032ab3d55d</entry>
Aug 09 23:00:10 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:00:10 user nova-compute[72409]:     </system>
Aug 09 23:00:10 user nova-compute[72409]:   </sysinfo>
Aug 09 23:00:10 user nova-compute[72409]:   <os>
Aug 09 23:00:10 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:00:10 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:00:10 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:00:10 user nova-compute[72409]:   </os>
Aug 09 23:00:10 user nova-compute[72409]:   <features>
Aug 09 23:00:10 user nova-compute[72409]:     <acpi/>
Aug 09 23:00:10 user nova-compute[72409]:     <apic/>
Aug 09 23:00:10 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:00:10 user nova-compute[72409]:   </features>
Aug 09 23:00:10 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:00:10 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:00:10 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:00:10 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:00:10 user nova-compute[72409]:   </clock>
Aug 09 23:00:10 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:00:10 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:00:10 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:00:10 user nova-compute[72409]:   </cpu>
Aug 09 23:00:10 user nova-compute[72409]:   <devices>
Aug 09 23:00:10 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 23:00:10 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:00:10 user nova-compute[72409]:       <source dev="/dev/sdf"/>
Aug 09 23:00:10 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:00:10 user nova-compute[72409]:       <serial>bc0dff38-7586-497d-84f5-6de5d3a113be</serial>
Aug 09 23:00:10 user nova-compute[72409]:     </disk>
Aug 09 23:00:10 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:00:10 user nova-compute[72409]:       <mac address="fa:16:3e:a3:31:62"/>
Aug 09 23:00:10 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:00:10 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:00:10 user nova-compute[72409]:       <target dev="tap1ad0ad00-60"/>
Aug 09 23:00:10 user nova-compute[72409]:     </interface>
Aug 09 23:00:10 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:00:10 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/66750137-9d3c-476b-b21b-10032ab3d55d/console.log" append="off"/>
Aug 09 23:00:10 user nova-compute[72409]:     </serial>
Aug 09 23:00:10 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:00:10 user nova-compute[72409]:     <video>
Aug 09 23:00:10 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:00:10 user nova-compute[72409]:     </video>
Aug 09 23:00:10 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:00:10 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:00:10 user nova-compute[72409]:     </rng>
Aug 09 23:00:10 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:00:10 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:00:10 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:00:10 user nova-compute[72409]:     </memballoon>
Aug 09 23:00:10 user nova-compute[72409]:   </devices>
Aug 09 23:00:10 user nova-compute[72409]: </domain>
Aug 09 23:00:10 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1341110089',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1341110089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1341110089',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK/hff2gw3r3ebPo5709PN+l9TEdCS3/+SPkoxsUa894NCFc/m4rcEOkzrjyZV5Y8ODUSMuMu76pNcC1+pmGKqfQ7naTeXsdRo0xdN5+IYrRrCmd/CQQJq9cHTVI8ecTg==',key_name='tempest-keypair-1532149728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-trc7six2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T22:59:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=66750137-9d3c-476b-b21b-10032ab3d55d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "address": "fa:16:3e:a3:31:62", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad0ad00-60", "ovs_interfaceid": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "address": "fa:16:3e:a3:31:62", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad0ad00-60", "ovs_interfaceid": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:31:62,bridge_name='br-int',has_traffic_filtering=True,id=1ad0ad00-6090-4417-80ed-1a3fb46e6c83,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad0ad00-60') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG os_vif [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:31:62,bridge_name='br-int',has_traffic_filtering=True,id=1ad0ad00-6090-4417-80ed-1a3fb46e6c83,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad0ad00-60') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ad0ad00-60, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ad0ad00-60, col_values=(('external_ids', {'iface-id': '1ad0ad00-6090-4417-80ed-1a3fb46e6c83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:31:62', 'vm-uuid': '66750137-9d3c-476b-b21b-10032ab3d55d'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:00:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:10 user nova-compute[72409]: INFO os_vif [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:31:62,bridge_name='br-int',has_traffic_filtering=True,id=1ad0ad00-6090-4417-80ed-1a3fb46e6c83,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad0ad00-60')
Aug 09 23:00:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:00:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] No VIF found with MAC fa:16:3e:a3:31:62, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:00:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-6f652347-ba31-4f8c-bf0e-b4a416e7e87a req-e3a0e056-5370-468e-827f-02b75d0c3edc service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Received event network-vif-plugged-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:00:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6f652347-ba31-4f8c-bf0e-b4a416e7e87a req-e3a0e056-5370-468e-827f-02b75d0c3edc service nova] Acquiring lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6f652347-ba31-4f8c-bf0e-b4a416e7e87a req-e3a0e056-5370-468e-827f-02b75d0c3edc service nova] Lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6f652347-ba31-4f8c-bf0e-b4a416e7e87a req-e3a0e056-5370-468e-827f-02b75d0c3edc service nova] Lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-6f652347-ba31-4f8c-bf0e-b4a416e7e87a req-e3a0e056-5370-468e-827f-02b75d0c3edc service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] No waiting events found dispatching network-vif-plugged-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:00:12 user nova-compute[72409]: WARNING nova.compute.manager [req-6f652347-ba31-4f8c-bf0e-b4a416e7e87a req-e3a0e056-5370-468e-827f-02b75d0c3edc service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Received unexpected event network-vif-plugged-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 for instance with vm_state building and task_state spawning.
Aug 09 23:00:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622014.3580682, 66750137-9d3c-476b-b21b-10032ab3d55d => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:00:14 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] VM Resumed (Lifecycle Event)
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.compute.manager [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:00:14 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Instance spawned successfully.
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:00:14 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622014.361485, 66750137-9d3c-476b-b21b-10032ab3d55d => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:00:14 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] VM Started (Lifecycle Event)
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:00:14 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:00:14 user nova-compute[72409]: INFO nova.compute.manager [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.compute.manager [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:00:14 user nova-compute[72409]: INFO nova.compute.manager [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Took 16.31 seconds to build instance.
Aug 09 23:00:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-31622a7b-69bf-45e3-90cc-66d5109297d0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "66750137-9d3c-476b-b21b-10032ab3d55d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.501s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-87ee4a65-6cd6-4f28-8087-43a94d58e712 req-ab6e48cb-0fd4-4c19-8145-cc0c320295f1 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Received event network-vif-plugged-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87ee4a65-6cd6-4f28-8087-43a94d58e712 req-ab6e48cb-0fd4-4c19-8145-cc0c320295f1 service nova] Acquiring lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87ee4a65-6cd6-4f28-8087-43a94d58e712 req-ab6e48cb-0fd4-4c19-8145-cc0c320295f1 service nova] Lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-87ee4a65-6cd6-4f28-8087-43a94d58e712 req-ab6e48cb-0fd4-4c19-8145-cc0c320295f1 service nova] Lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-87ee4a65-6cd6-4f28-8087-43a94d58e712 req-ab6e48cb-0fd4-4c19-8145-cc0c320295f1 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] No waiting events found dispatching network-vif-plugged-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:00:14 user nova-compute[72409]: WARNING nova.compute.manager [req-87ee4a65-6cd6-4f28-8087-43a94d58e712 req-ab6e48cb-0fd4-4c19-8145-cc0c320295f1 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Received unexpected event network-vif-plugged-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 for instance with vm_state active and task_state None.
Aug 09 23:00:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:28 user nova-compute[72409]: INFO nova.compute.manager [None req-098fee5b-43b7-4345-a1ed-94fffded402c tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Unrescuing
Aug 09 23:00:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-098fee5b-43b7-4345-a1ed-94fffded402c tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "refresh_cache-6540903a-e102-40b3-833b-1ec5031c6d82" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:00:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-098fee5b-43b7-4345-a1ed-94fffded402c tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquired lock "refresh_cache-6540903a-e102-40b3-833b-1ec5031c6d82" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:00:28 user nova-compute[72409]: DEBUG nova.network.neutron [None req-098fee5b-43b7-4345-a1ed-94fffded402c tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:00:28 user nova-compute[72409]: DEBUG nova.network.neutron [None req-098fee5b-43b7-4345-a1ed-94fffded402c tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Updating instance_info_cache with network_info: [{"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:00:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-098fee5b-43b7-4345-a1ed-94fffded402c tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Releasing lock "refresh_cache-6540903a-e102-40b3-833b-1ec5031c6d82" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:00:28 user nova-compute[72409]: DEBUG nova.objects.instance [None req-098fee5b-43b7-4345-a1ed-94fffded402c tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'flavor' on Instance uuid 6540903a-e102-40b3-833b-1ec5031c6d82 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:00:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:29 user nova-compute[72409]: DEBUG nova.compute.manager [req-b859902f-e8b0-4da7-a033-e8ed2a944e72 req-c04ddd36-b4f9-4c3d-9959-b68d1fcfe6fb service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-unplugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:00:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b859902f-e8b0-4da7-a033-e8ed2a944e72 req-c04ddd36-b4f9-4c3d-9959-b68d1fcfe6fb service nova] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b859902f-e8b0-4da7-a033-e8ed2a944e72 req-c04ddd36-b4f9-4c3d-9959-b68d1fcfe6fb service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b859902f-e8b0-4da7-a033-e8ed2a944e72 req-c04ddd36-b4f9-4c3d-9959-b68d1fcfe6fb service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:29 user nova-compute[72409]: DEBUG nova.compute.manager [req-b859902f-e8b0-4da7-a033-e8ed2a944e72 req-c04ddd36-b4f9-4c3d-9959-b68d1fcfe6fb service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] No waiting events found dispatching network-vif-unplugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:00:29 user nova-compute[72409]: WARNING nova.compute.manager [req-b859902f-e8b0-4da7-a033-e8ed2a944e72 req-c04ddd36-b4f9-4c3d-9959-b68d1fcfe6fb service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received unexpected event network-vif-unplugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:00:29 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Instance destroyed successfully.
Aug 09 23:00:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-26db5abe-368b-4b39-9274-a68199e7d033 req-02843c2d-8a94-42ea-b45b-518228747785 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-26db5abe-368b-4b39-9274-a68199e7d033 req-02843c2d-8a94-42ea-b45b-518228747785 service nova] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-26db5abe-368b-4b39-9274-a68199e7d033 req-02843c2d-8a94-42ea-b45b-518228747785 service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-26db5abe-368b-4b39-9274-a68199e7d033 req-02843c2d-8a94-42ea-b45b-518228747785 service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-26db5abe-368b-4b39-9274-a68199e7d033 req-02843c2d-8a94-42ea-b45b-518228747785 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] No waiting events found dispatching network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:00:31 user nova-compute[72409]: WARNING nova.compute.manager [req-26db5abe-368b-4b39-9274-a68199e7d033 req-02843c2d-8a94-42ea-b45b-518228747785 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received unexpected event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:00:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-26db5abe-368b-4b39-9274-a68199e7d033 req-02843c2d-8a94-42ea-b45b-518228747785 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-26db5abe-368b-4b39-9274-a68199e7d033 req-02843c2d-8a94-42ea-b45b-518228747785 service nova] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-26db5abe-368b-4b39-9274-a68199e7d033 req-02843c2d-8a94-42ea-b45b-518228747785 service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-26db5abe-368b-4b39-9274-a68199e7d033 req-02843c2d-8a94-42ea-b45b-518228747785 service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-26db5abe-368b-4b39-9274-a68199e7d033 req-02843c2d-8a94-42ea-b45b-518228747785 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] No waiting events found dispatching network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:00:31 user nova-compute[72409]: WARNING nova.compute.manager [req-26db5abe-368b-4b39-9274-a68199e7d033 req-02843c2d-8a94-42ea-b45b-518228747785 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received unexpected event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:00:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Removed pending event for 6540903a-e102-40b3-833b-1ec5031c6d82 due to event {{(pid=72409) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 23:00:33 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622033.3946764, 6540903a-e102-40b3-833b-1ec5031c6d82 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:00:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] VM Resumed (Lifecycle Event)
Aug 09 23:00:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-098fee5b-43b7-4345-a1ed-94fffded402c tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:00:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:00:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:00:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 23:00:33 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622033.3978343, 6540903a-e102-40b3-833b-1ec5031c6d82 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:00:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] VM Started (Lifecycle Event)
Aug 09 23:00:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:00:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:00:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-f8d1fb99-0297-4bda-9105-c172900a11b5 req-5d153cb9-034e-48b7-b690-22695ad027df service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:00:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f8d1fb99-0297-4bda-9105-c172900a11b5 req-5d153cb9-034e-48b7-b690-22695ad027df service nova] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f8d1fb99-0297-4bda-9105-c172900a11b5 req-5d153cb9-034e-48b7-b690-22695ad027df service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f8d1fb99-0297-4bda-9105-c172900a11b5 req-5d153cb9-034e-48b7-b690-22695ad027df service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-f8d1fb99-0297-4bda-9105-c172900a11b5 req-5d153cb9-034e-48b7-b690-22695ad027df service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] No waiting events found dispatching network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:00:33 user nova-compute[72409]: WARNING nova.compute.manager [req-f8d1fb99-0297-4bda-9105-c172900a11b5 req-5d153cb9-034e-48b7-b690-22695ad027df service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received unexpected event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 for instance with vm_state active and task_state None.
Aug 09 23:00:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "297f364c-8f40-410a-ad2e-c56d822a757e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "297f364c-8f40-410a-ad2e-c56d822a757e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:00:46 user nova-compute[72409]: INFO nova.compute.claims [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Claim successful on node user
Aug 09 23:00:46 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:00:46 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:00:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG nova.policy [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '539168ee5b36474680b3e9fc785a2237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ec6e31abf4e89847c80adbb45be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:00:46 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Creating image(s)
Aug 09 23:00:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "/opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "/opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "/opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.144s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk 1073741824" returned: 0 in 0.063s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.149s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Cannot resize image /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG nova.objects.instance [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lazy-loading 'migration_context' on Instance uuid 297f364c-8f40-410a-ad2e-c56d822a757e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Ensure instance console log exists: /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:48 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Successfully created port: e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:00:49 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Successfully updated port: e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:00:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "refresh_cache-297f364c-8f40-410a-ad2e-c56d822a757e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:00:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquired lock "refresh_cache-297f364c-8f40-410a-ad2e-c56d822a757e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:00:49 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:00:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-2044fc2a-2485-4475-bb8c-8ea0d02f0188 req-9eb26ef4-5bfa-4280-847c-bc31cc649a4b service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Received event network-changed-e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:00:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-2044fc2a-2485-4475-bb8c-8ea0d02f0188 req-9eb26ef4-5bfa-4280-847c-bc31cc649a4b service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Refreshing instance network info cache due to event network-changed-e60933af-9d7b-4f1d-bfbc-c202db40a783. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:00:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2044fc2a-2485-4475-bb8c-8ea0d02f0188 req-9eb26ef4-5bfa-4280-847c-bc31cc649a4b service nova] Acquiring lock "refresh_cache-297f364c-8f40-410a-ad2e-c56d822a757e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.network.neutron [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Updating instance_info_cache with network_info: [{"id": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "address": "fa:16:3e:2a:f7:e9", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60933af-9d", "ovs_interfaceid": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Releasing lock "refresh_cache-297f364c-8f40-410a-ad2e-c56d822a757e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Instance network_info: |[{"id": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "address": "fa:16:3e:2a:f7:e9", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60933af-9d", "ovs_interfaceid": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2044fc2a-2485-4475-bb8c-8ea0d02f0188 req-9eb26ef4-5bfa-4280-847c-bc31cc649a4b service nova] Acquired lock "refresh_cache-297f364c-8f40-410a-ad2e-c56d822a757e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.network.neutron [req-2044fc2a-2485-4475-bb8c-8ea0d02f0188 req-9eb26ef4-5bfa-4280-847c-bc31cc649a4b service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Refreshing network info cache for port e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Start _get_guest_xml network_info=[{"id": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "address": "fa:16:3e:2a:f7:e9", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60933af-9d", "ovs_interfaceid": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:00:50 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:00:50 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2081870308',display_name='tempest-VolumesSnapshotTestJSON-instance-2081870308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2081870308',id=28,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnqLAv3+6fqV1ApORltOPUdAJE3eln5jZMMiZH7YRZIpmvBpsDpJjzOougqbamh/XMQ8GIoHcCoI0ZsTa+QkwIaQDi06zHZ5FbVdU1VKUvGrFpNE3k8iBvfL09BuMpkFg==',key_name='tempest-keypair-661746355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='302ec6e31abf4e89847c80adbb45be87',ramdisk_id='',reservation_id='r-xr81j5y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-725320644',owner_user_name='tempest-VolumesSnapshotTestJSON-725320644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539168ee5b36474680b3e9fc785a2237',uuid=297f364c-8f40-410a-ad2e-c56d822a757e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "address": "fa:16:3e:2a:f7:e9", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60933af-9d", "ovs_interfaceid": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Converting VIF {"id": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "address": "fa:16:3e:2a:f7:e9", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60933af-9d", "ovs_interfaceid": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e60933af-9d7b-4f1d-bfbc-c202db40a783,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60933af-9d') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.objects.instance [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lazy-loading 'pci_devices' on Instance uuid 297f364c-8f40-410a-ad2e-c56d822a757e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:00:50 user nova-compute[72409]:   <uuid>297f364c-8f40-410a-ad2e-c56d822a757e</uuid>
Aug 09 23:00:50 user nova-compute[72409]:   <name>instance-0000001c</name>
Aug 09 23:00:50 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:00:50 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:00:50 user nova-compute[72409]:   <metadata>
Aug 09 23:00:50 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:00:50 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:00:50 user nova-compute[72409]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2081870308</nova:name>
Aug 09 23:00:50 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:00:50</nova:creationTime>
Aug 09 23:00:50 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:00:50 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:00:50 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:00:50 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:00:50 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:00:50 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:00:50 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:00:50 user nova-compute[72409]:       <nova:owner>
Aug 09 23:00:50 user nova-compute[72409]:         <nova:user uuid="539168ee5b36474680b3e9fc785a2237">tempest-VolumesSnapshotTestJSON-725320644-project-member</nova:user>
Aug 09 23:00:50 user nova-compute[72409]:         <nova:project uuid="302ec6e31abf4e89847c80adbb45be87">tempest-VolumesSnapshotTestJSON-725320644</nova:project>
Aug 09 23:00:50 user nova-compute[72409]:       </nova:owner>
Aug 09 23:00:50 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:00:50 user nova-compute[72409]:       <nova:ports>
Aug 09 23:00:50 user nova-compute[72409]:         <nova:port uuid="e60933af-9d7b-4f1d-bfbc-c202db40a783">
Aug 09 23:00:50 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 23:00:50 user nova-compute[72409]:         </nova:port>
Aug 09 23:00:50 user nova-compute[72409]:       </nova:ports>
Aug 09 23:00:50 user nova-compute[72409]:     </nova:instance>
Aug 09 23:00:50 user nova-compute[72409]:   </metadata>
Aug 09 23:00:50 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:00:50 user nova-compute[72409]:     <system>
Aug 09 23:00:50 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:00:50 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:00:50 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:00:50 user nova-compute[72409]:       <entry name="serial">297f364c-8f40-410a-ad2e-c56d822a757e</entry>
Aug 09 23:00:50 user nova-compute[72409]:       <entry name="uuid">297f364c-8f40-410a-ad2e-c56d822a757e</entry>
Aug 09 23:00:50 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:00:50 user nova-compute[72409]:     </system>
Aug 09 23:00:50 user nova-compute[72409]:   </sysinfo>
Aug 09 23:00:50 user nova-compute[72409]:   <os>
Aug 09 23:00:50 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:00:50 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:00:50 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:00:50 user nova-compute[72409]:   </os>
Aug 09 23:00:50 user nova-compute[72409]:   <features>
Aug 09 23:00:50 user nova-compute[72409]:     <acpi/>
Aug 09 23:00:50 user nova-compute[72409]:     <apic/>
Aug 09 23:00:50 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:00:50 user nova-compute[72409]:   </features>
Aug 09 23:00:50 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:00:50 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:00:50 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:00:50 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:00:50 user nova-compute[72409]:   </clock>
Aug 09 23:00:50 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:00:50 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:00:50 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:00:50 user nova-compute[72409]:   </cpu>
Aug 09 23:00:50 user nova-compute[72409]:   <devices>
Aug 09 23:00:50 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:00:50 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:00:50 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk"/>
Aug 09 23:00:50 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:00:50 user nova-compute[72409]:     </disk>
Aug 09 23:00:50 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:00:50 user nova-compute[72409]:       <mac address="fa:16:3e:2a:f7:e9"/>
Aug 09 23:00:50 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:00:50 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:00:50 user nova-compute[72409]:       <target dev="tape60933af-9d"/>
Aug 09 23:00:50 user nova-compute[72409]:     </interface>
Aug 09 23:00:50 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:00:50 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/console.log" append="off"/>
Aug 09 23:00:50 user nova-compute[72409]:     </serial>
Aug 09 23:00:50 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:00:50 user nova-compute[72409]:     <video>
Aug 09 23:00:50 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:00:50 user nova-compute[72409]:     </video>
Aug 09 23:00:50 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:00:50 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:00:50 user nova-compute[72409]:     </rng>
Aug 09 23:00:50 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:00:50 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:00:50 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:00:50 user nova-compute[72409]:     </memballoon>
Aug 09 23:00:50 user nova-compute[72409]:   </devices>
Aug 09 23:00:50 user nova-compute[72409]: </domain>
Aug 09 23:00:50 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2081870308',display_name='tempest-VolumesSnapshotTestJSON-instance-2081870308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2081870308',id=28,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnqLAv3+6fqV1ApORltOPUdAJE3eln5jZMMiZH7YRZIpmvBpsDpJjzOougqbamh/XMQ8GIoHcCoI0ZsTa+QkwIaQDi06zHZ5FbVdU1VKUvGrFpNE3k8iBvfL09BuMpkFg==',key_name='tempest-keypair-661746355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='302ec6e31abf4e89847c80adbb45be87',ramdisk_id='',reservation_id='r-xr81j5y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-725320644',owner_user_name='tempest-VolumesSnapshotTestJSON-725320644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539168ee5b36474680b3e9fc785a2237',uuid=297f364c-8f40-410a-ad2e-c56d822a757e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "address": "fa:16:3e:2a:f7:e9", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60933af-9d", "ovs_interfaceid": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Converting VIF {"id": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "address": "fa:16:3e:2a:f7:e9", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60933af-9d", "ovs_interfaceid": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e60933af-9d7b-4f1d-bfbc-c202db40a783,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60933af-9d') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG os_vif [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e60933af-9d7b-4f1d-bfbc-c202db40a783,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60933af-9d') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape60933af-9d, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape60933af-9d, col_values=(('external_ids', {'iface-id': 'e60933af-9d7b-4f1d-bfbc-c202db40a783', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:f7:e9', 'vm-uuid': '297f364c-8f40-410a-ad2e-c56d822a757e'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:00:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:50 user nova-compute[72409]: INFO os_vif [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e60933af-9d7b-4f1d-bfbc-c202db40a783,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60933af-9d')
Aug 09 23:00:50 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:00:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:00:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] No VIF found with MAC fa:16:3e:2a:f7:e9, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:00:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG nova.network.neutron [req-2044fc2a-2485-4475-bb8c-8ea0d02f0188 req-9eb26ef4-5bfa-4280-847c-bc31cc649a4b service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Updated VIF entry in instance network info cache for port e60933af-9d7b-4f1d-bfbc-c202db40a783. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG nova.network.neutron [req-2044fc2a-2485-4475-bb8c-8ea0d02f0188 req-9eb26ef4-5bfa-4280-847c-bc31cc649a4b service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Updating instance_info_cache with network_info: [{"id": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "address": "fa:16:3e:2a:f7:e9", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60933af-9d", "ovs_interfaceid": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2044fc2a-2485-4475-bb8c-8ea0d02f0188 req-9eb26ef4-5bfa-4280-847c-bc31cc649a4b service nova] Releasing lock "refresh_cache-297f364c-8f40-410a-ad2e-c56d822a757e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-9124f05d-7cef-4356-ad4d-16a749638dae req-145baa95-2489-4e68-9da7-67fa99515f62 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Received event network-vif-plugged-e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9124f05d-7cef-4356-ad4d-16a749638dae req-145baa95-2489-4e68-9da7-67fa99515f62 service nova] Acquiring lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9124f05d-7cef-4356-ad4d-16a749638dae req-145baa95-2489-4e68-9da7-67fa99515f62 service nova] Lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9124f05d-7cef-4356-ad4d-16a749638dae req-145baa95-2489-4e68-9da7-67fa99515f62 service nova] Lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-9124f05d-7cef-4356-ad4d-16a749638dae req-145baa95-2489-4e68-9da7-67fa99515f62 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] No waiting events found dispatching network-vif-plugged-e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:00:52 user nova-compute[72409]: WARNING nova.compute.manager [req-9124f05d-7cef-4356-ad4d-16a749638dae req-145baa95-2489-4e68-9da7-67fa99515f62 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Received unexpected event network-vif-plugged-e60933af-9d7b-4f1d-bfbc-c202db40a783 for instance with vm_state building and task_state spawning.
Aug 09 23:00:52 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:00:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 23:00:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-c7d214cb-b649-4c85-9298-affb127785c5 req-f2ff0030-88d3-46ce-9e90-205c7806c6f6 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Received event network-vif-plugged-e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c7d214cb-b649-4c85-9298-affb127785c5 req-f2ff0030-88d3-46ce-9e90-205c7806c6f6 service nova] Acquiring lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c7d214cb-b649-4c85-9298-affb127785c5 req-f2ff0030-88d3-46ce-9e90-205c7806c6f6 service nova] Lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c7d214cb-b649-4c85-9298-affb127785c5 req-f2ff0030-88d3-46ce-9e90-205c7806c6f6 service nova] Lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-c7d214cb-b649-4c85-9298-affb127785c5 req-f2ff0030-88d3-46ce-9e90-205c7806c6f6 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] No waiting events found dispatching network-vif-plugged-e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:00:54 user nova-compute[72409]: WARNING nova.compute.manager [req-c7d214cb-b649-4c85-9298-affb127785c5 req-f2ff0030-88d3-46ce-9e90-205c7806c6f6 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Received unexpected event network-vif-plugged-e60933af-9d7b-4f1d-bfbc-c202db40a783 for instance with vm_state building and task_state spawning.
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622054.871334, 297f364c-8f40-410a-ad2e-c56d822a757e => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:00:54 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] VM Resumed (Lifecycle Event)
Aug 09 23:00:54 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:00:54 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Instance spawned successfully.
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:00:54 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622054.879526, 297f364c-8f40-410a-ad2e-c56d822a757e => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:00:54 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] VM Started (Lifecycle Event)
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:00:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:00:55 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:00:55 user nova-compute[72409]: INFO nova.compute.manager [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Took 8.24 seconds to spawn the instance on the hypervisor.
Aug 09 23:00:55 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:00:55 user nova-compute[72409]: INFO nova.compute.manager [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Took 9.21 seconds to build instance.
Aug 09 23:00:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c1e2c8f-a48f-4c3a-a752-9de1b591b6ba tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "297f364c-8f40-410a-ad2e-c56d822a757e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.338s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:00:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:00:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:00:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:00:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:00:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:00:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:00:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:00:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.377s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.321s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:00:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:00:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:00:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:00:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG nova.compute.manager [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:00 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:01:00 user nova-compute[72409]: INFO nova.compute.claims [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Claim successful on node user
Aug 09 23:01:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:01 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:01:01 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:01:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7320MB free_disk=25.030445098876953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:01:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:01 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Refreshing inventories for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 23:01:01 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Updating ProviderTree inventory for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 23:01:01 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 23:01:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:01 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Refreshing aggregate associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, aggregates: None {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 23:01:01 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Refreshing trait associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.338s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.642s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.network.neutron [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:01:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Applying migration context for instance c513e397-28f7-4d93-8487-257becbef9d3 as it has an incoming, in-progress migration 892604ee-5dbb-4bea-9fa5-8c96ad738b30. Migration status is finished {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 23:01:02 user nova-compute[72409]: INFO nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating resource usage from migration 892604ee-5dbb-4bea-9fa5-8c96ad738b30
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5b7906a3-e02b-49a3-9a56-fc34a8730238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c17c9b77-8e04-432c-9634-c4bee2eb8889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 6540903a-e102-40b3-833b-1ec5031c6d82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 65d39a39-3616-40db-906b-d4327e1d63c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Migration 892604ee-5dbb-4bea-9fa5-8c96ad738b30 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c513e397-28f7-4d93-8487-257becbef9d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 66750137-9d3c-476b-b21b-10032ab3d55d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 297f364c-8f40-410a-ad2e-c56d822a757e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance f6761b27-e1f3-4f6e-a7e7-990910a3523b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:01:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Creating image(s)
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "/opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "/opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.026s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG nova.policy [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a397a72346b447c2a6947599c46efd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd02446693acb409e81e2484a006ec6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.180s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.179s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk 1073741824" returned: 0 in 0.080s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.942s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] There are 0 instances to clean {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.213s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Cannot resize image /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG nova.objects.instance [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lazy-loading 'migration_context' on Instance uuid f6761b27-e1f3-4f6e-a7e7-990910a3523b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Ensure instance console log exists: /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:03 user nova-compute[72409]: DEBUG nova.network.neutron [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Successfully created port: 94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:01:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:01:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:01:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-5b7906a3-e02b-49a3-9a56-fc34a8730238" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:01:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-5b7906a3-e02b-49a3-9a56-fc34a8730238" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:01:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:01:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Successfully updated port: 94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:01:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "refresh_cache-f6761b27-e1f3-4f6e-a7e7-990910a3523b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:01:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquired lock "refresh_cache-f6761b27-e1f3-4f6e-a7e7-990910a3523b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:01:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.compute.manager [req-6a8a8dde-8faf-42dd-aa8a-8fc66450bf6f req-ac77bf51-916c-4a44-94de-cf68eddeba84 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Received event network-changed-94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.compute.manager [req-6a8a8dde-8faf-42dd-aa8a-8fc66450bf6f req-ac77bf51-916c-4a44-94de-cf68eddeba84 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Refreshing instance network info cache due to event network-changed-94290ac9-5002-469d-babb-28d9d4adbaba. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a8a8dde-8faf-42dd-aa8a-8fc66450bf6f req-ac77bf51-916c-4a44-94de-cf68eddeba84 service nova] Acquiring lock "refresh_cache-f6761b27-e1f3-4f6e-a7e7-990910a3523b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.network.neutron [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Updating instance_info_cache with network_info: [{"id": "a3239f85-cc45-49f5-97a6-b936267579a8", "address": "fa:16:3e:00:16:76", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3239f85-cc", "ovs_interfaceid": "a3239f85-cc45-49f5-97a6-b936267579a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-5b7906a3-e02b-49a3-9a56-fc34a8730238" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.network.neutron [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Updating instance_info_cache with network_info: [{"id": "94290ac9-5002-469d-babb-28d9d4adbaba", "address": "fa:16:3e:ac:30:2c", "network": {"id": "4ce575ab-a977-48a1-a305-3b5df321a3d3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1866075743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02446693acb409e81e2484a006ec6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94290ac9-50", "ovs_interfaceid": "94290ac9-5002-469d-babb-28d9d4adbaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Releasing lock "refresh_cache-f6761b27-e1f3-4f6e-a7e7-990910a3523b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Instance network_info: |[{"id": "94290ac9-5002-469d-babb-28d9d4adbaba", "address": "fa:16:3e:ac:30:2c", "network": {"id": "4ce575ab-a977-48a1-a305-3b5df321a3d3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1866075743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02446693acb409e81e2484a006ec6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94290ac9-50", "ovs_interfaceid": "94290ac9-5002-469d-babb-28d9d4adbaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a8a8dde-8faf-42dd-aa8a-8fc66450bf6f req-ac77bf51-916c-4a44-94de-cf68eddeba84 service nova] Acquired lock "refresh_cache-f6761b27-e1f3-4f6e-a7e7-990910a3523b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.network.neutron [req-6a8a8dde-8faf-42dd-aa8a-8fc66450bf6f req-ac77bf51-916c-4a44-94de-cf68eddeba84 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Refreshing network info cache for port 94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Start _get_guest_xml network_info=[{"id": "94290ac9-5002-469d-babb-28d9d4adbaba", "address": "fa:16:3e:ac:30:2c", "network": {"id": "4ce575ab-a977-48a1-a305-3b5df321a3d3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1866075743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02446693acb409e81e2484a006ec6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94290ac9-50", "ovs_interfaceid": "94290ac9-5002-469d-babb-28d9d4adbaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:01:05 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:01:05 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-571125330',display_name='tempest-TestServerVolumeAttachmentScenario-server-571125330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-571125330',id=29,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGONOUwxVKM4+YKyjgkpQ4QvUnX7IXAVu6XIapZY4ba4wPrGDZqnB38jcPyUIn+ocEz8eBKFt3caRzSfI+MDvjdgiWhoU9BNeUSsHAGvmnCaWBGSoDYIinHxmdx4ZfChbQ==',key_name='tempest-keypair-414375781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d02446693acb409e81e2484a006ec6f0',ramdisk_id='',reservation_id='r-z5bff21h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-678273191',owner_user_name='tempest-TestServerVolumeAttachmentScenario-678273191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:01:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a397a72346b447c2a6947599c46efd46',uuid=f6761b27-e1f3-4f6e-a7e7-990910a3523b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94290ac9-5002-469d-babb-28d9d4adbaba", "address": "fa:16:3e:ac:30:2c", "network": {"id": "4ce575ab-a977-48a1-a305-3b5df321a3d3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1866075743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02446693acb409e81e2484a006ec6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94290ac9-50", "ovs_interfaceid": "94290ac9-5002-469d-babb-28d9d4adbaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Converting VIF {"id": "94290ac9-5002-469d-babb-28d9d4adbaba", "address": "fa:16:3e:ac:30:2c", "network": {"id": "4ce575ab-a977-48a1-a305-3b5df321a3d3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1866075743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02446693acb409e81e2484a006ec6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94290ac9-50", "ovs_interfaceid": "94290ac9-5002-469d-babb-28d9d4adbaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:30:2c,bridge_name='br-int',has_traffic_filtering=True,id=94290ac9-5002-469d-babb-28d9d4adbaba,network=Network(4ce575ab-a977-48a1-a305-3b5df321a3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94290ac9-50') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.objects.instance [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lazy-loading 'pci_devices' on Instance uuid f6761b27-e1f3-4f6e-a7e7-990910a3523b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:01:05 user nova-compute[72409]:   <uuid>f6761b27-e1f3-4f6e-a7e7-990910a3523b</uuid>
Aug 09 23:01:05 user nova-compute[72409]:   <name>instance-0000001d</name>
Aug 09 23:01:05 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:01:05 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:01:05 user nova-compute[72409]:   <metadata>
Aug 09 23:01:05 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:01:05 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:01:05 user nova-compute[72409]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-571125330</nova:name>
Aug 09 23:01:05 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:01:05</nova:creationTime>
Aug 09 23:01:05 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:01:05 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:01:05 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:01:05 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:01:05 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:01:05 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:01:05 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:01:05 user nova-compute[72409]:       <nova:owner>
Aug 09 23:01:05 user nova-compute[72409]:         <nova:user uuid="a397a72346b447c2a6947599c46efd46">tempest-TestServerVolumeAttachmentScenario-678273191-project-member</nova:user>
Aug 09 23:01:05 user nova-compute[72409]:         <nova:project uuid="d02446693acb409e81e2484a006ec6f0">tempest-TestServerVolumeAttachmentScenario-678273191</nova:project>
Aug 09 23:01:05 user nova-compute[72409]:       </nova:owner>
Aug 09 23:01:05 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:01:05 user nova-compute[72409]:       <nova:ports>
Aug 09 23:01:05 user nova-compute[72409]:         <nova:port uuid="94290ac9-5002-469d-babb-28d9d4adbaba">
Aug 09 23:01:05 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 23:01:05 user nova-compute[72409]:         </nova:port>
Aug 09 23:01:05 user nova-compute[72409]:       </nova:ports>
Aug 09 23:01:05 user nova-compute[72409]:     </nova:instance>
Aug 09 23:01:05 user nova-compute[72409]:   </metadata>
Aug 09 23:01:05 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:01:05 user nova-compute[72409]:     <system>
Aug 09 23:01:05 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:01:05 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:01:05 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:01:05 user nova-compute[72409]:       <entry name="serial">f6761b27-e1f3-4f6e-a7e7-990910a3523b</entry>
Aug 09 23:01:05 user nova-compute[72409]:       <entry name="uuid">f6761b27-e1f3-4f6e-a7e7-990910a3523b</entry>
Aug 09 23:01:05 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:01:05 user nova-compute[72409]:     </system>
Aug 09 23:01:05 user nova-compute[72409]:   </sysinfo>
Aug 09 23:01:05 user nova-compute[72409]:   <os>
Aug 09 23:01:05 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:01:05 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:01:05 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:01:05 user nova-compute[72409]:   </os>
Aug 09 23:01:05 user nova-compute[72409]:   <features>
Aug 09 23:01:05 user nova-compute[72409]:     <acpi/>
Aug 09 23:01:05 user nova-compute[72409]:     <apic/>
Aug 09 23:01:05 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:01:05 user nova-compute[72409]:   </features>
Aug 09 23:01:05 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:01:05 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:01:05 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:01:05 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:01:05 user nova-compute[72409]:   </clock>
Aug 09 23:01:05 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:01:05 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:01:05 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:01:05 user nova-compute[72409]:   </cpu>
Aug 09 23:01:05 user nova-compute[72409]:   <devices>
Aug 09 23:01:05 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:01:05 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:01:05 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk"/>
Aug 09 23:01:05 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:01:05 user nova-compute[72409]:     </disk>
Aug 09 23:01:05 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:01:05 user nova-compute[72409]:       <mac address="fa:16:3e:ac:30:2c"/>
Aug 09 23:01:05 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:01:05 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:01:05 user nova-compute[72409]:       <target dev="tap94290ac9-50"/>
Aug 09 23:01:05 user nova-compute[72409]:     </interface>
Aug 09 23:01:05 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:01:05 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/console.log" append="off"/>
Aug 09 23:01:05 user nova-compute[72409]:     </serial>
Aug 09 23:01:05 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:01:05 user nova-compute[72409]:     <video>
Aug 09 23:01:05 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:01:05 user nova-compute[72409]:     </video>
Aug 09 23:01:05 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:01:05 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:01:05 user nova-compute[72409]:     </rng>
Aug 09 23:01:05 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:01:05 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:01:05 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:01:05 user nova-compute[72409]:     </memballoon>
Aug 09 23:01:05 user nova-compute[72409]:   </devices>
Aug 09 23:01:05 user nova-compute[72409]: </domain>
Aug 09 23:01:05 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-571125330',display_name='tempest-TestServerVolumeAttachmentScenario-server-571125330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-571125330',id=29,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGONOUwxVKM4+YKyjgkpQ4QvUnX7IXAVu6XIapZY4ba4wPrGDZqnB38jcPyUIn+ocEz8eBKFt3caRzSfI+MDvjdgiWhoU9BNeUSsHAGvmnCaWBGSoDYIinHxmdx4ZfChbQ==',key_name='tempest-keypair-414375781',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d02446693acb409e81e2484a006ec6f0',ramdisk_id='',reservation_id='r-z5bff21h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-678273191',owner_user_name='tempest-TestServerVolumeAttachmentScenario-678273191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:01:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a397a72346b447c2a6947599c46efd46',uuid=f6761b27-e1f3-4f6e-a7e7-990910a3523b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94290ac9-5002-469d-babb-28d9d4adbaba", "address": "fa:16:3e:ac:30:2c", "network": {"id": "4ce575ab-a977-48a1-a305-3b5df321a3d3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1866075743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02446693acb409e81e2484a006ec6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94290ac9-50", "ovs_interfaceid": "94290ac9-5002-469d-babb-28d9d4adbaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Converting VIF {"id": "94290ac9-5002-469d-babb-28d9d4adbaba", "address": "fa:16:3e:ac:30:2c", "network": {"id": "4ce575ab-a977-48a1-a305-3b5df321a3d3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1866075743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02446693acb409e81e2484a006ec6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94290ac9-50", "ovs_interfaceid": "94290ac9-5002-469d-babb-28d9d4adbaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:30:2c,bridge_name='br-int',has_traffic_filtering=True,id=94290ac9-5002-469d-babb-28d9d4adbaba,network=Network(4ce575ab-a977-48a1-a305-3b5df321a3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94290ac9-50') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG os_vif [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:30:2c,bridge_name='br-int',has_traffic_filtering=True,id=94290ac9-5002-469d-babb-28d9d4adbaba,network=Network(4ce575ab-a977-48a1-a305-3b5df321a3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94290ac9-50') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94290ac9-50, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94290ac9-50, col_values=(('external_ids', {'iface-id': '94290ac9-5002-469d-babb-28d9d4adbaba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:30:2c', 'vm-uuid': 'f6761b27-e1f3-4f6e-a7e7-990910a3523b'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:05 user nova-compute[72409]: INFO os_vif [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:30:2c,bridge_name='br-int',has_traffic_filtering=True,id=94290ac9-5002-469d-babb-28d9d4adbaba,network=Network(4ce575ab-a977-48a1-a305-3b5df321a3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94290ac9-50')
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:01:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] No VIF found with MAC fa:16:3e:ac:30:2c, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:01:06 user nova-compute[72409]: DEBUG nova.network.neutron [req-6a8a8dde-8faf-42dd-aa8a-8fc66450bf6f req-ac77bf51-916c-4a44-94de-cf68eddeba84 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Updated VIF entry in instance network info cache for port 94290ac9-5002-469d-babb-28d9d4adbaba. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:01:06 user nova-compute[72409]: DEBUG nova.network.neutron [req-6a8a8dde-8faf-42dd-aa8a-8fc66450bf6f req-ac77bf51-916c-4a44-94de-cf68eddeba84 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Updating instance_info_cache with network_info: [{"id": "94290ac9-5002-469d-babb-28d9d4adbaba", "address": "fa:16:3e:ac:30:2c", "network": {"id": "4ce575ab-a977-48a1-a305-3b5df321a3d3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1866075743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02446693acb409e81e2484a006ec6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94290ac9-50", "ovs_interfaceid": "94290ac9-5002-469d-babb-28d9d4adbaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:01:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a8a8dde-8faf-42dd-aa8a-8fc66450bf6f req-ac77bf51-916c-4a44-94de-cf68eddeba84 service nova] Releasing lock "refresh_cache-f6761b27-e1f3-4f6e-a7e7-990910a3523b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:01:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "3f216945-199d-4047-8bc8-407d5842c536" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:06 user nova-compute[72409]: INFO nova.compute.manager [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Detaching volume b3dd997e-509b-4f16-813a-70e82d2d3168
Aug 09 23:01:06 user nova-compute[72409]: INFO nova.virt.block_device [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Attempting to driver detach volume b3dd997e-509b-4f16-813a-70e82d2d3168 from mountpoint /dev/vdb
Aug 09 23:01:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Attempting to detach device vdb from instance 3f216945-199d-4047-8bc8-407d5842c536 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:01:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:01:06 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:01:06 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 23:01:06 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:01:06 user nova-compute[72409]:   <serial>b3dd997e-509b-4f16-813a-70e82d2d3168</serial>
Aug 09 23:01:06 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 23:01:06 user nova-compute[72409]: </disk>
Aug 09 23:01:06 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:01:06 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Successfully detached device vdb from instance 3f216945-199d-4047-8bc8-407d5842c536 from the persistent domain config.
Aug 09 23:01:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f216945-199d-4047-8bc8-407d5842c536 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:01:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:01:06 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:01:06 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 23:01:06 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:01:06 user nova-compute[72409]:   <serial>b3dd997e-509b-4f16-813a-70e82d2d3168</serial>
Aug 09 23:01:06 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 23:01:06 user nova-compute[72409]: </disk>
Aug 09 23:01:06 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:01:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622067.1083238, 3f216945-199d-4047-8bc8-407d5842c536 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:01:07 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Successfully detached device vdb from instance 3f216945-199d-4047-8bc8-407d5842c536 from the live domain config.
Aug 09 23:01:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bovJOXEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:01:07 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.051s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f2d94f-c4e6-42fc-90a4-30febc2656a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:005a277e-f0e0-400e-a96e-d80148ec669c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b730f20-be93-4140-b59b-45eb75601f84]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:005a277e-f0e0-400e-a96e-d80148ec669c (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:07 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 23:01:07 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:01:07 user nova-compute[72409]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:01:07 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:07 user nova-compute[72409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:005a277e-f0e0-400e-a96e-d80148ec669c (non-flash)
Aug 09 23:01:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:07 user nova-compute[72409]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 (non-flash)
Aug 09 23:01:07 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:01:07 user nova-compute[72409]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:01:07 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:07 user nova-compute[72409]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:005a277e-f0e0-400e-a96e-d80148ec669c (non-flash)
Aug 09 23:01:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e844e96c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168'): ({'sdd'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Removing single pathed devices sdd {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.168s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c7f5eb-75d4-44f9-b0e9-0ab548591e0e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9312b581-71d6-47f2-bcd9-7075570f8bba]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Flushing IO for device /dev/sdd {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.039s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a13926b-595f-4fe3-88cd-05e45fd40aaf]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[832f3fc7-416f-4d7b-a8e8-44a677d93082]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.158s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab66adf-3bf0-4ab6-9d8f-0aca39d62e5e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG nova.compute.manager [req-331eb9ac-bc6b-47ef-9f9a-fb494e0bba12 req-f705539c-3f8c-4eb7-8811-93f0fe5edd07 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Received event network-vif-plugged-94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-331eb9ac-bc6b-47ef-9f9a-fb494e0bba12 req-f705539c-3f8c-4eb7-8811-93f0fe5edd07 service nova] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-331eb9ac-bc6b-47ef-9f9a-fb494e0bba12 req-f705539c-3f8c-4eb7-8811-93f0fe5edd07 service nova] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-331eb9ac-bc6b-47ef-9f9a-fb494e0bba12 req-f705539c-3f8c-4eb7-8811-93f0fe5edd07 service nova] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG nova.compute.manager [req-331eb9ac-bc6b-47ef-9f9a-fb494e0bba12 req-f705539c-3f8c-4eb7-8811-93f0fe5edd07 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] No waiting events found dispatching network-vif-plugged-94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:01:08 user nova-compute[72409]: WARNING nova.compute.manager [req-331eb9ac-bc6b-47ef-9f9a-fb494e0bba12 req-f705539c-3f8c-4eb7-8811-93f0fe5edd07 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Received unexpected event network-vif-plugged-94290ac9-5002-469d-babb-28d9d4adbaba for instance with vm_state building and task_state spawning.
Aug 09 23:01:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --logout" returned: 0 in 0.274s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d60671a-d9ac-4d89-9ae6-5f85eeeccbcb]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260]
Aug 09 23:01:08 user nova-compute[72409]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168, portal: 172.16.0.220,3260] successful.
Aug 09 23:01:08 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3dd997e-509b-4f16-813a-70e82d2d3168 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbec889-fc01-4f68-8523-c2dca4176249]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.963s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== disconnect_volume: return (964ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:09 user nova-compute[72409]: DEBUG nova.objects.instance [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'flavor' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-42934158-5d93-4a97-9eee-1146c7d52501 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "3f216945-199d-4047-8bc8-407d5842c536" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.963s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:09 user nova-compute[72409]: DEBUG nova.network.neutron [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Port 6afaf787-02f9-400f-b7a9-b0aa4df58939 binding to destination host user is already ACTIVE {{(pid=72409) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 23:01:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:01:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquired lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:01:09 user nova-compute[72409]: DEBUG nova.network.neutron [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating instance_info_cache with network_info: [{"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Releasing lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Creating tmpfile /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/tmpp430cnaz to verify with other compute node that the instance is on the same shared storage. {{(pid=72409) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-7e638698-c642-47de-8aac-976c35585074 req-e02e207b-2fad-4f0e-aa2c-d0c2e1e8810f service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Received event network-vif-plugged-94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7e638698-c642-47de-8aac-976c35585074 req-e02e207b-2fad-4f0e-aa2c-d0c2e1e8810f service nova] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7e638698-c642-47de-8aac-976c35585074 req-e02e207b-2fad-4f0e-aa2c-d0c2e1e8810f service nova] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7e638698-c642-47de-8aac-976c35585074 req-e02e207b-2fad-4f0e-aa2c-d0c2e1e8810f service nova] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-7e638698-c642-47de-8aac-976c35585074 req-e02e207b-2fad-4f0e-aa2c-d0c2e1e8810f service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] No waiting events found dispatching network-vif-plugged-94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:01:10 user nova-compute[72409]: WARNING nova.compute.manager [req-7e638698-c642-47de-8aac-976c35585074 req-e02e207b-2fad-4f0e-aa2c-d0c2e1e8810f service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Received unexpected event network-vif-plugged-94290ac9-5002-469d-babb-28d9d4adbaba for instance with vm_state building and task_state spawning.
Aug 09 23:01:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622070.5858643, f6761b27-e1f3-4f6e-a7e7-990910a3523b => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:01:10 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] VM Resumed (Lifecycle Event)
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:01:10 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Instance spawned successfully.
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:01:10 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622070.588057, f6761b27-e1f3-4f6e-a7e7-990910a3523b => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:01:10 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] VM Started (Lifecycle Event)
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:01:10 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:01:10 user nova-compute[72409]: INFO nova.compute.manager [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Took 8.50 seconds to spawn the instance on the hypervisor.
Aug 09 23:01:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:01:11 user nova-compute[72409]: INFO nova.compute.manager [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Took 10.51 seconds to build instance.
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-955b6300-91ea-4846-9a66-1bf52768e214 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.682s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:11 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Instance destroyed successfully.
Aug 09 23:01:11 user nova-compute[72409]: DEBUG nova.objects.instance [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'resources' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2097419676',display_name='tempest-ServerActionsTestOtherB-server-2097419676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2097419676',id=19,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDelHCC8nFCHRTmFXWR19BOOB/f+NPR90u8i8YXxlReJTIRJmpJsKKUPRbCWzHe6UX+HR9F8ZTKdA6A0YGmKOztUWCiwbCDEi2c3eCmLXAc66rx+Q4ob5pL4kfTx6LhQUg==',key_name='tempest-keypair-351454578',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:59:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a302bac664904169ad012943400598db',ramdisk_id='',reservation_id='r-pfgn9xa9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-68548202',owner_user_name='tempest-ServerActionsTestOtherB-68548202-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d662607342934fb7babc31e155f5d915',uuid=c513e397-28f7-4d93-8487-257becbef9d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converting VIF {"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_vif [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6afaf787-02, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:01:11 user nova-compute[72409]: INFO os_vif [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02')
Aug 09 23:01:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqbIjKzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:01:11 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c11c128-a6ec-4a08-b6e9-3f7a0522bcbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a478d2e-d82e-4b8d-b8de-2bd42ba6ff1c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:11 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:01:11 user nova-compute[72409]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:01:11 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:11 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:11 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:01:11 user nova-compute[72409]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:01:11 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:11 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84435480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'): ({'sde'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Removing single pathed devices sde {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f844ce6-5bcf-41cd-9356-cf1430315bf5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[570b90e4-a573-4a3e-a96f-da6ef84f7644]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Flushing IO for device /dev/sde {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[37463e15-7fec-4960-bed8-e89cca2659b6]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f29a12-a0f8-42ab-a9c7-24dbeafc41ed]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27fbed0-12f5-43f9-abe1-bd4d7da04553]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdc1579-cebe-4f8f-bedc-9f96331aae25]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260]
Aug 09 23:01:11 user nova-compute[72409]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260] successful.
Aug 09 23:01:11 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fe9225-c00f-46cb-bf5a-2d9ef3a2602b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] <== disconnect_volume: return (314ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:01:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-a1dbb640-a330-4836-8d61-5e20d4ebaeb2 req-b7e30a31-8634-4a84-86d6-49eb0fc999e1 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-unplugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a1dbb640-a330-4836-8d61-5e20d4ebaeb2 req-b7e30a31-8634-4a84-86d6-49eb0fc999e1 service nova] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a1dbb640-a330-4836-8d61-5e20d4ebaeb2 req-b7e30a31-8634-4a84-86d6-49eb0fc999e1 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a1dbb640-a330-4836-8d61-5e20d4ebaeb2 req-b7e30a31-8634-4a84-86d6-49eb0fc999e1 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-a1dbb640-a330-4836-8d61-5e20d4ebaeb2 req-b7e30a31-8634-4a84-86d6-49eb0fc999e1 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] No waiting events found dispatching network-vif-unplugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:01:12 user nova-compute[72409]: WARNING nova.compute.manager [req-a1dbb640-a330-4836-8d61-5e20d4ebaeb2 req-b7e30a31-8634-4a84-86d6-49eb0fc999e1 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received unexpected event network-vif-unplugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 for instance with vm_state resized and task_state resize_reverting.
Aug 09 23:01:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-a1dbb640-a330-4836-8d61-5e20d4ebaeb2 req-b7e30a31-8634-4a84-86d6-49eb0fc999e1 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a1dbb640-a330-4836-8d61-5e20d4ebaeb2 req-b7e30a31-8634-4a84-86d6-49eb0fc999e1 service nova] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a1dbb640-a330-4836-8d61-5e20d4ebaeb2 req-b7e30a31-8634-4a84-86d6-49eb0fc999e1 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a1dbb640-a330-4836-8d61-5e20d4ebaeb2 req-b7e30a31-8634-4a84-86d6-49eb0fc999e1 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-a1dbb640-a330-4836-8d61-5e20d4ebaeb2 req-b7e30a31-8634-4a84-86d6-49eb0fc999e1 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] No waiting events found dispatching network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:01:12 user nova-compute[72409]: WARNING nova.compute.manager [req-a1dbb640-a330-4836-8d61-5e20d4ebaeb2 req-b7e30a31-8634-4a84-86d6-49eb0fc999e1 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received unexpected event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 for instance with vm_state resized and task_state resize_reverting.
Aug 09 23:01:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG nova.objects.instance [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'migration_context' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:01:12 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.412s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:13 user nova-compute[72409]: INFO nova.compute.manager [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Swapping old allocation on dict_keys(['3270f7d5-46eb-4359-8572-5a68440c59c2']) held by migration 892604ee-5dbb-4bea-9fa5-8c96ad738b30 for instance
Aug 09 23:01:13 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Overwriting current allocation {'allocations': {'3270f7d5-46eb-4359-8572-5a68440c59c2': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 34}}, 'project_id': 'a302bac664904169ad012943400598db', 'user_id': 'd662607342934fb7babc31e155f5d915', 'consumer_generation': 1} on consumer c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquired lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG nova.network.neutron [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG nova.network.neutron [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating instance_info_cache with network_info: [{"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Releasing lock "refresh_cache-c513e397-28f7-4d93-8487-257becbef9d3" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG os_brick.utils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b33b066-6096-400c-9a63-2ae7ca38216e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca90935-d9f3-4378-a3f9-3ee2c88f4dbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.061s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f154ea1-6b0e-4785-9c72-b1142128021a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cf974e-a56e-4801-a0e7-54f38a3d72b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:01:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:01:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:01:14 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:01:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b49ebaa-3cc1-4b3e-90b8-d22d5102da27]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:01:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:01:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:01:14 user nova-compute[72409]: DEBUG os_brick.utils [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:01:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:01:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:19 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:01:19 user nova-compute[72409]: INFO nova.compute.claims [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Claim successful on node user
Aug 09 23:01:19 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:01:19 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:01:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:01:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:01:19 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:01:19 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:01:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:01:20 user nova-compute[72409]: INFO nova.virt.block_device [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Booting with volume c4fec0e3-71b7-473e-b72a-5f9656c2c15f at /dev/vda
Aug 09 23:01:20 user nova-compute[72409]: DEBUG nova.policy [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6357af30a40c4e9ebae912eabba0bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac38a10bc4f46f8acdca4eec503b76f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG os_brick.utils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac8c5a2-7bdb-446b-b267-101066b05a6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8114feb0-ad01-4693-9029-f6ce4ca45794]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6d0023-7806-4cd9-a93a-291bd81f7d15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e916393e-bac7-418c-81c7-98894b93429f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:01:20 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:01:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e27ca5-4260-4bb4-bbcd-d83b48e071f5]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG os_brick.utils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:01:20 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updating existing volume attachment record: 06fa0e85-5e42-42ac-9b6a-d3b3978b8907 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:01:21 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Successfully created port: f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:01:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:21 user nova-compute[72409]: INFO nova.compute.manager [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Unshelving
Aug 09 23:01:21 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Successfully updated port: f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:01:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:01:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquired lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:01:21 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:01:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-5b843273-09a8-48b2-adea-8feb3836ea5f req-5e3f648e-2d87-4b49-a561-62d958a9c7a0 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-changed-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-5b843273-09a8-48b2-adea-8feb3836ea5f req-5e3f648e-2d87-4b49-a561-62d958a9c7a0 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Refreshing instance network info cache due to event network-changed-f26d04f1-ec38-48a6-840e-cf9d48203a37. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:01:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5b843273-09a8-48b2-adea-8feb3836ea5f req-5e3f648e-2d87-4b49-a561-62d958a9c7a0 service nova] Acquiring lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG nova.objects.instance [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'pci_requests' on Instance uuid 913c4e3b-f449-45fa-9ca7-3cef4b982679 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG nova.objects.instance [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'numa_topology' on Instance uuid 913c4e3b-f449-45fa-9ca7-3cef4b982679 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:01:22 user nova-compute[72409]: INFO nova.compute.claims [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Claim successful on node user
Aug 09 23:01:22 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updating instance_info_cache with network_info: [{"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Releasing lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Instance network_info: |[{"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5b843273-09a8-48b2-adea-8feb3836ea5f req-5e3f648e-2d87-4b49-a561-62d958a9c7a0 service nova] Acquired lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG nova.network.neutron [req-5b843273-09a8-48b2-adea-8feb3836ea5f req-5e3f648e-2d87-4b49-a561-62d958a9c7a0 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Refreshing network info cache for port f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:01:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.866s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:22 user nova-compute[72409]: INFO nova.network.neutron [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updating port a80bd290-a75e-4702-b917-3319bee30a60 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 23:01:23 user nova-compute[72409]: DEBUG nova.network.neutron [req-5b843273-09a8-48b2-adea-8feb3836ea5f req-5e3f648e-2d87-4b49-a561-62d958a9c7a0 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updated VIF entry in instance network info cache for port f26d04f1-ec38-48a6-840e-cf9d48203a37. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:01:23 user nova-compute[72409]: DEBUG nova.network.neutron [req-5b843273-09a8-48b2-adea-8feb3836ea5f req-5e3f648e-2d87-4b49-a561-62d958a9c7a0 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updating instance_info_cache with network_info: [{"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:01:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5b843273-09a8-48b2-adea-8feb3836ea5f req-5e3f648e-2d87-4b49-a561-62d958a9c7a0 service nova] Releasing lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:01:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:01:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquired lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:01:23 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:01:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-a6717522-0a92-4c62-9d33-b3efc43e9e9f req-0d4d2297-1851-4f22-96d1-5f00e0673061 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-changed-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-a6717522-0a92-4c62-9d33-b3efc43e9e9f req-0d4d2297-1851-4f22-96d1-5f00e0673061 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Refreshing instance network info cache due to event network-changed-a80bd290-a75e-4702-b917-3319bee30a60. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:01:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a6717522-0a92-4c62-9d33-b3efc43e9e9f req-0d4d2297-1851-4f22-96d1-5f00e0673061 service nova] Acquiring lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:01:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Starting finish_revert_migration {{(pid=72409) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Start _get_guest_xml network_info=[{"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqbIjKzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c513e397-28f7-4d93-8487-257becbef9d3', 'attached_at': '2023-08-09T23:01:24.000000', 'detached_at': '', 'volume_id': 'ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35', 'serial': 'ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'}, 'mount_device': '/dev/vdb', 'attachment_id': 'fd7c7d78-bacb-4e56-9536-01825560d21b', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:01:24 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:01:24 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.objects.instance [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'vcpu_model' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqbIjKzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:01:24 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:01:24 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:01:24 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f70e13-d358-44a3-b80d-f0798fd23479]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:01:24 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46dc218-190b-4155-bace-dd9091e82be7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35] added
Aug 09 23:01:24 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2424b08-cb3b-46c2-b037-9caba62929ba]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc67942b-4b26-4a20-aa84-b64d92ea55b2]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqbIjKzx {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqbIjKzx" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc9b64d-39bd-41cd-8e26-b89be6fa0874]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RqbIjKzx'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd59a48a-9efb-486c-a3b8-4cb7a09aceab]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d460665-e2f1-4f72-be70-3476db24594e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:24 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:01:24 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:24 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:24 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:01:24 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:24 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updating instance_info_cache with network_info: [{"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Releasing lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:01:24 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Creating image(s)
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "/opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "/opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "/opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.objects.instance [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'trusted_certs' on Instance uuid 913c4e3b-f449-45fa-9ca7-3cef4b982679 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a6717522-0a92-4c62-9d33-b3efc43e9e9f req-0d4d2297-1851-4f22-96d1-5f00e0673061 service nova] Acquired lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG nova.network.neutron [req-a6717522-0a92-4c62-9d33-b3efc43e9e9f req-0d4d2297-1851-4f22-96d1-5f00e0673061 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Refreshing network info cache for port a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "59076043f652cc9aea7a1d4d30570edbc51128e2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "59076043f652cc9aea7a1d4d30570edbc51128e2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b243613-40b0-4003-84ed-fb2770b63e57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260]
Aug 09 23:01:24 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260] successful.
Aug 09 23:01:24 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4eab84-4d06-4cb9-b956-75bb1367dd23]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd8eaef-2f76-482e-83a4-474609d713d8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:24 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:01:24 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:24 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:01:24 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:24 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:01:24 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:24 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:01:24 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.030s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e30799a-5a26-422b-aadf-4c5cf97b1a3b]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:01:24 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqbIjKzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2.part --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2.part --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG nova.virt.images [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] 4c55318f-277e-4268-b40a-d8349ba092d6 was qcow2, converting to raw {{(pid=72409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2.part /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2.converted {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23863343064623135', 'path': '/dev/sdd'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863343064623135', 'path': '/dev/sdd'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2097419676',display_name='tempest-ServerActionsTestOtherB-server-2097419676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2097419676',id=19,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDelHCC8nFCHRTmFXWR19BOOB/f+NPR90u8i8YXxlReJTIRJmpJsKKUPRbCWzHe6UX+HR9F8ZTKdA6A0YGmKOztUWCiwbCDEi2c3eCmLXAc66rx+Q4ob5pL4kfTx6LhQUg==',key_name='tempest-keypair-351454578',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:59:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a302bac664904169ad012943400598db',ramdisk_id='',reservation_id='r-pfgn9xa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-68548202',owner_user_name='tempest-ServerActionsTestOtherB-68548202-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d662607342934fb7babc31e155f5d915',uuid=c513e397-28f7-4d93-8487-257becbef9d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converting VIF {"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:01:25 user nova-compute[72409]:   <uuid>c513e397-28f7-4d93-8487-257becbef9d3</uuid>
Aug 09 23:01:25 user nova-compute[72409]:   <name>instance-00000013</name>
Aug 09 23:01:25 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:01:25 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:01:25 user nova-compute[72409]:   <metadata>
Aug 09 23:01:25 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:01:25 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:01:25 user nova-compute[72409]:       <nova:name>tempest-ServerActionsTestOtherB-server-2097419676</nova:name>
Aug 09 23:01:25 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:01:24</nova:creationTime>
Aug 09 23:01:25 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:01:25 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:01:25 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:01:25 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:01:25 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:01:25 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:01:25 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:01:25 user nova-compute[72409]:       <nova:owner>
Aug 09 23:01:25 user nova-compute[72409]:         <nova:user uuid="d662607342934fb7babc31e155f5d915">tempest-ServerActionsTestOtherB-68548202-project-member</nova:user>
Aug 09 23:01:25 user nova-compute[72409]:         <nova:project uuid="a302bac664904169ad012943400598db">tempest-ServerActionsTestOtherB-68548202</nova:project>
Aug 09 23:01:25 user nova-compute[72409]:       </nova:owner>
Aug 09 23:01:25 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:01:25 user nova-compute[72409]:       <nova:ports>
Aug 09 23:01:25 user nova-compute[72409]:         <nova:port uuid="6afaf787-02f9-400f-b7a9-b0aa4df58939">
Aug 09 23:01:25 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 23:01:25 user nova-compute[72409]:         </nova:port>
Aug 09 23:01:25 user nova-compute[72409]:       </nova:ports>
Aug 09 23:01:25 user nova-compute[72409]:     </nova:instance>
Aug 09 23:01:25 user nova-compute[72409]:   </metadata>
Aug 09 23:01:25 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:01:25 user nova-compute[72409]:     <system>
Aug 09 23:01:25 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:01:25 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:01:25 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:01:25 user nova-compute[72409]:       <entry name="serial">c513e397-28f7-4d93-8487-257becbef9d3</entry>
Aug 09 23:01:25 user nova-compute[72409]:       <entry name="uuid">c513e397-28f7-4d93-8487-257becbef9d3</entry>
Aug 09 23:01:25 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:01:25 user nova-compute[72409]:     </system>
Aug 09 23:01:25 user nova-compute[72409]:   </sysinfo>
Aug 09 23:01:25 user nova-compute[72409]:   <os>
Aug 09 23:01:25 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:01:25 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:01:25 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:01:25 user nova-compute[72409]:   </os>
Aug 09 23:01:25 user nova-compute[72409]:   <features>
Aug 09 23:01:25 user nova-compute[72409]:     <acpi/>
Aug 09 23:01:25 user nova-compute[72409]:     <apic/>
Aug 09 23:01:25 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:01:25 user nova-compute[72409]:   </features>
Aug 09 23:01:25 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:01:25 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:01:25 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:01:25 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:01:25 user nova-compute[72409]:   </clock>
Aug 09 23:01:25 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:01:25 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:01:25 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:01:25 user nova-compute[72409]:   </cpu>
Aug 09 23:01:25 user nova-compute[72409]:   <devices>
Aug 09 23:01:25 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:01:25 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:01:25 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk"/>
Aug 09 23:01:25 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:01:25 user nova-compute[72409]:     </disk>
Aug 09 23:01:25 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 23:01:25 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:01:25 user nova-compute[72409]:       <source dev="/dev/sdd"/>
Aug 09 23:01:25 user nova-compute[72409]:       <target dev="vdb" bus="virtio"/>
Aug 09 23:01:25 user nova-compute[72409]:       <serial>ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35</serial>
Aug 09 23:01:25 user nova-compute[72409]:     </disk>
Aug 09 23:01:25 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:01:25 user nova-compute[72409]:       <mac address="fa:16:3e:26:c6:8e"/>
Aug 09 23:01:25 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:01:25 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:01:25 user nova-compute[72409]:       <target dev="tap6afaf787-02"/>
Aug 09 23:01:25 user nova-compute[72409]:     </interface>
Aug 09 23:01:25 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:01:25 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/console.log" append="off"/>
Aug 09 23:01:25 user nova-compute[72409]:     </serial>
Aug 09 23:01:25 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:01:25 user nova-compute[72409]:     <video>
Aug 09 23:01:25 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:01:25 user nova-compute[72409]:     </video>
Aug 09 23:01:25 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:01:25 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:01:25 user nova-compute[72409]:     </rng>
Aug 09 23:01:25 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:01:25 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:01:25 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:01:25 user nova-compute[72409]:     </memballoon>
Aug 09 23:01:25 user nova-compute[72409]:   </devices>
Aug 09 23:01:25 user nova-compute[72409]: </domain>
Aug 09 23:01:25 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2097419676',display_name='tempest-ServerActionsTestOtherB-server-2097419676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2097419676',id=19,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDelHCC8nFCHRTmFXWR19BOOB/f+NPR90u8i8YXxlReJTIRJmpJsKKUPRbCWzHe6UX+HR9F8ZTKdA6A0YGmKOztUWCiwbCDEi2c3eCmLXAc66rx+Q4ob5pL4kfTx6LhQUg==',key_name='tempest-keypair-351454578',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:59:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a302bac664904169ad012943400598db',ramdisk_id='',reservation_id='r-pfgn9xa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-68548202',owner_user_name='tempest-ServerActionsTestOtherB-68548202-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d662607342934fb7babc31e155f5d915',uuid=c513e397-28f7-4d93-8487-257becbef9d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converting VIF {"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG os_vif [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6afaf787-02, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6afaf787-02, col_values=(('external_ids', {'iface-id': '6afaf787-02f9-400f-b7a9-b0aa4df58939', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:c6:8e', 'vm-uuid': 'c513e397-28f7-4d93-8487-257becbef9d3'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:25 user nova-compute[72409]: INFO os_vif [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02')
Aug 09 23:01:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2.part /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2.converted" returned: 0 in 0.306s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2.converted --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2.converted --force-share --output=json" returned: 0 in 0.162s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "59076043f652cc9aea7a1d4d30570edbc51128e2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.512s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2 --force-share --output=json" returned: 0 in 0.154s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "59076043f652cc9aea7a1d4d30570edbc51128e2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "59076043f652cc9aea7a1d4d30570edbc51128e2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG nova.network.neutron [req-a6717522-0a92-4c62-9d33-b3efc43e9e9f req-0d4d2297-1851-4f22-96d1-5f00e0673061 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updated VIF entry in instance network info cache for port a80bd290-a75e-4702-b917-3319bee30a60. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG nova.network.neutron [req-a6717522-0a92-4c62-9d33-b3efc43e9e9f req-0d4d2297-1851-4f22-96d1-5f00e0673061 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updating instance_info_cache with network_info: [{"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2 --force-share --output=json" returned: 0 in 0.162s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2,backing_fmt=raw /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a6717522-0a92-4c62-9d33-b3efc43e9e9f req-0d4d2297-1851-4f22-96d1-5f00e0673061 service nova] Releasing lock "refresh_cache-913c4e3b-f449-45fa-9ca7-3cef4b982679" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2,backing_fmt=raw /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk 1073741824" returned: 0 in 0.055s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "59076043f652cc9aea7a1d4d30570edbc51128e2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622071.2371063, c513e397-28f7-4d93-8487-257becbef9d3 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:01:26 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] VM Stopped (Lifecycle Event)
Aug 09 23:01:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d03f21e8-8331-4ba8-847a-630a5ad02b99 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2 --force-share --output=json" returned: 0 in 0.200s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG nova.objects.instance [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'migration_context' on Instance uuid 913c4e3b-f449-45fa-9ca7-3cef4b982679 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Rebasing disk image.
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.156s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e -F raw /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-816748b4-c3d1-4882-a917-00fd1f7c836c req-fbf15ab0-a981-4ccc-875e-2f4f72eb8bec service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-816748b4-c3d1-4882-a917-00fd1f7c836c req-fbf15ab0-a981-4ccc-875e-2f4f72eb8bec service nova] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-816748b4-c3d1-4882-a917-00fd1f7c836c req-fbf15ab0-a981-4ccc-875e-2f4f72eb8bec service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-816748b4-c3d1-4882-a917-00fd1f7c836c req-fbf15ab0-a981-4ccc-875e-2f4f72eb8bec service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.015s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-816748b4-c3d1-4882-a917-00fd1f7c836c req-fbf15ab0-a981-4ccc-875e-2f4f72eb8bec service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] No waiting events found dispatching network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:01:27 user nova-compute[72409]: WARNING nova.compute.manager [req-816748b4-c3d1-4882-a917-00fd1f7c836c req-fbf15ab0-a981-4ccc-875e-2f4f72eb8bec service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received unexpected event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 for instance with vm_state resized and task_state resize_reverting.
Aug 09 23:01:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e -F raw /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk" returned: 0 in 2.175s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Ensure instance console log exists: /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Start _get_guest_xml network_info=[{"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='6bee9da6a07b4f9bcf4fe684cbc8ef57',container_format='bare',created_at=2023-08-09T22:59:28Z,direct_url=<?>,disk_format='qcow2',id=4c55318f-277e-4268-b40a-d8349ba092d6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1373843419-shelved',owner='894e6764aa794ff29ce4bc213a7def7d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T22:59:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:01:28 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:01:28 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6bee9da6a07b4f9bcf4fe684cbc8ef57',container_format='bare',created_at=2023-08-09T22:59:28Z,direct_url=<?>,disk_format='qcow2',id=4c55318f-277e-4268-b40a-d8349ba092d6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1373843419-shelved',owner='894e6764aa794ff29ce4bc213a7def7d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T22:59:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.objects.instance [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'vcpu_model' on Instance uuid 913c4e3b-f449-45fa-9ca7-3cef4b982679 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T22:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1373843419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1373843419',id=25,image_ref='4c55318f-277e-4268-b40a-d8349ba092d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-656104974',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='894e6764aa794ff29ce4bc213a7def7d',ramdisk_id='',reservation_id='r-0g99dck8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-723310053',owner_user_name='tempest-AttachVolumeShelveTestJSON-723310053-project-member',shelved_at='2023-08-09T22:59:32.824646',shelved_host='user',shelved_image_id='4c55318f-277e-4268-b40a-d8349ba092d6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:01:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce008676a8de41b8b2ffe79ab31462df',uuid=913c4e3b-f449-45fa-9ca7-3cef4b982679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converting VIF {"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.objects.instance [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'pci_devices' on Instance uuid 913c4e3b-f449-45fa-9ca7-3cef4b982679 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:01:28 user nova-compute[72409]:   <uuid>913c4e3b-f449-45fa-9ca7-3cef4b982679</uuid>
Aug 09 23:01:28 user nova-compute[72409]:   <name>instance-00000019</name>
Aug 09 23:01:28 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:01:28 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:01:28 user nova-compute[72409]:   <metadata>
Aug 09 23:01:28 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:01:28 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:01:28 user nova-compute[72409]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1373843419</nova:name>
Aug 09 23:01:28 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:01:28</nova:creationTime>
Aug 09 23:01:28 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:01:28 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:01:28 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:01:28 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:01:28 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:01:28 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:01:28 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:01:28 user nova-compute[72409]:       <nova:owner>
Aug 09 23:01:28 user nova-compute[72409]:         <nova:user uuid="ce008676a8de41b8b2ffe79ab31462df">tempest-AttachVolumeShelveTestJSON-723310053-project-member</nova:user>
Aug 09 23:01:28 user nova-compute[72409]:         <nova:project uuid="894e6764aa794ff29ce4bc213a7def7d">tempest-AttachVolumeShelveTestJSON-723310053</nova:project>
Aug 09 23:01:28 user nova-compute[72409]:       </nova:owner>
Aug 09 23:01:28 user nova-compute[72409]:       <nova:root type="image" uuid="4c55318f-277e-4268-b40a-d8349ba092d6"/>
Aug 09 23:01:28 user nova-compute[72409]:       <nova:ports>
Aug 09 23:01:28 user nova-compute[72409]:         <nova:port uuid="a80bd290-a75e-4702-b917-3319bee30a60">
Aug 09 23:01:28 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 23:01:28 user nova-compute[72409]:         </nova:port>
Aug 09 23:01:28 user nova-compute[72409]:       </nova:ports>
Aug 09 23:01:28 user nova-compute[72409]:     </nova:instance>
Aug 09 23:01:28 user nova-compute[72409]:   </metadata>
Aug 09 23:01:28 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:01:28 user nova-compute[72409]:     <system>
Aug 09 23:01:28 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:01:28 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:01:28 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:01:28 user nova-compute[72409]:       <entry name="serial">913c4e3b-f449-45fa-9ca7-3cef4b982679</entry>
Aug 09 23:01:28 user nova-compute[72409]:       <entry name="uuid">913c4e3b-f449-45fa-9ca7-3cef4b982679</entry>
Aug 09 23:01:28 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:01:28 user nova-compute[72409]:     </system>
Aug 09 23:01:28 user nova-compute[72409]:   </sysinfo>
Aug 09 23:01:28 user nova-compute[72409]:   <os>
Aug 09 23:01:28 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:01:28 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:01:28 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:01:28 user nova-compute[72409]:   </os>
Aug 09 23:01:28 user nova-compute[72409]:   <features>
Aug 09 23:01:28 user nova-compute[72409]:     <acpi/>
Aug 09 23:01:28 user nova-compute[72409]:     <apic/>
Aug 09 23:01:28 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:01:28 user nova-compute[72409]:   </features>
Aug 09 23:01:28 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:01:28 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:01:28 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:01:28 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:01:28 user nova-compute[72409]:   </clock>
Aug 09 23:01:28 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:01:28 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:01:28 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:01:28 user nova-compute[72409]:   </cpu>
Aug 09 23:01:28 user nova-compute[72409]:   <devices>
Aug 09 23:01:28 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:01:28 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:01:28 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk"/>
Aug 09 23:01:28 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:01:28 user nova-compute[72409]:     </disk>
Aug 09 23:01:28 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:01:28 user nova-compute[72409]:       <mac address="fa:16:3e:cf:69:56"/>
Aug 09 23:01:28 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:01:28 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:01:28 user nova-compute[72409]:       <target dev="tapa80bd290-a7"/>
Aug 09 23:01:28 user nova-compute[72409]:     </interface>
Aug 09 23:01:28 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:01:28 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/console.log" append="off"/>
Aug 09 23:01:28 user nova-compute[72409]:     </serial>
Aug 09 23:01:28 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:01:28 user nova-compute[72409]:     <video>
Aug 09 23:01:28 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:01:28 user nova-compute[72409]:     </video>
Aug 09 23:01:28 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:01:28 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:01:28 user nova-compute[72409]:     </rng>
Aug 09 23:01:28 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:01:28 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:01:28 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:01:28 user nova-compute[72409]:     </memballoon>
Aug 09 23:01:28 user nova-compute[72409]:   </devices>
Aug 09 23:01:28 user nova-compute[72409]: </domain>
Aug 09 23:01:28 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T22:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1373843419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1373843419',id=25,image_ref='4c55318f-277e-4268-b40a-d8349ba092d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-656104974',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:57:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='894e6764aa794ff29ce4bc213a7def7d',ramdisk_id='',reservation_id='r-0g99dck8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-723310053',owner_user_name='tempest-AttachVolumeShelveTestJSON-723310053-project-member',shelved_at='2023-08-09T22:59:32.824646',shelved_host='user',shelved_image_id='4c55318f-277e-4268-b40a-d8349ba092d6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:01:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce008676a8de41b8b2ffe79ab31462df',uuid=913c4e3b-f449-45fa-9ca7-3cef4b982679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converting VIF {"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG os_vif [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa80bd290-a7, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa80bd290-a7, col_values=(('external_ids', {'iface-id': 'a80bd290-a75e-4702-b917-3319bee30a60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:69:56', 'vm-uuid': '913c4e3b-f449-45fa-9ca7-3cef4b982679'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:01:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:28 user nova-compute[72409]: INFO os_vif [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7')
Aug 09 23:01:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:01:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] No VIF found with MAC fa:16:3e:cf:69:56, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:01:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:01:29 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622089.5924134, c513e397-28f7-4d93-8487-257becbef9d3 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:01:29 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] VM Resumed (Lifecycle Event)
Aug 09 23:01:29 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Instance running successfully.
Aug 09 23:01:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] finish_revert_migration finished successfully. {{(pid=72409) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 09 23:01:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:01:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:01:29 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 23:01:29 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622089.6028485, c513e397-28f7-4d93-8487-257becbef9d3 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:01:29 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] VM Started (Lifecycle Event)
Aug 09 23:01:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:01:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:01:29 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 23:01:29 user nova-compute[72409]: INFO nova.compute.manager [None req-699b78be-43f0-4ad7-9609-f5c4a73538fe tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating instance to original state: 'active'
Aug 09 23:01:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] No waiting events found dispatching network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:01:30 user nova-compute[72409]: WARNING nova.compute.manager [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received unexpected event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 for instance with vm_state active and task_state None.
Aug 09 23:01:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-changed-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Refreshing instance network info cache due to event network-changed-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] Acquiring lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] Acquired lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Refreshing network info cache for port d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-9a2eef7a-0338-4c2e-97a5-cb9b5031dfd4 req-4f8f304b-9c61-48b5-a106-81f459a47853 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-changed-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-9a2eef7a-0338-4c2e-97a5-cb9b5031dfd4 req-4f8f304b-9c61-48b5-a106-81f459a47853 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Refreshing instance network info cache due to event network-changed-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a2eef7a-0338-4c2e-97a5-cb9b5031dfd4 req-4f8f304b-9c61-48b5-a106-81f459a47853 service nova] Acquiring lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:30 user nova-compute[72409]: INFO nova.compute.manager [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Detaching volume 23978613-d1bf-48c8-b5e7-83727d93e2cd
Aug 09 23:01:30 user nova-compute[72409]: INFO nova.virt.block_device [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Attempting to driver detach volume 23978613-d1bf-48c8-b5e7-83727d93e2cd from mountpoint /dev/vdb
Aug 09 23:01:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Attempting to detach device vdb from instance 65d39a39-3616-40db-906b-d4327e1d63c5 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:01:31 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:01:31 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:01:31 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:01:31 user nova-compute[72409]:   <serial>23978613-d1bf-48c8-b5e7-83727d93e2cd</serial>
Aug 09 23:01:31 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 23:01:31 user nova-compute[72409]: </disk>
Aug 09 23:01:31 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:01:31 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Successfully detached device vdb from instance 65d39a39-3616-40db-906b-d4327e1d63c5 from the persistent domain config.
Aug 09 23:01:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65d39a39-3616-40db-906b-d4327e1d63c5 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:01:31 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:01:31 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:01:31 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:01:31 user nova-compute[72409]:   <serial>23978613-d1bf-48c8-b5e7-83727d93e2cd</serial>
Aug 09 23:01:31 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 23:01:31 user nova-compute[72409]: </disk>
Aug 09 23:01:31 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG nova.network.neutron [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updated VIF entry in instance network info cache for port d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG nova.network.neutron [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updating instance_info_cache with network_info: [{"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2e898e12-4e63-4531-8c81-d42296553817 req-efbf8334-53d3-4aab-a48f-cd0fd0d67564 service nova] Releasing lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a2eef7a-0338-4c2e-97a5-cb9b5031dfd4 req-4f8f304b-9c61-48b5-a106-81f459a47853 service nova] Acquired lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG nova.network.neutron [req-9a2eef7a-0338-4c2e-97a5-cb9b5031dfd4 req-4f8f304b-9c61-48b5-a106-81f459a47853 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Refreshing network info cache for port d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622091.5255642, 65d39a39-3616-40db-906b-d4327e1d63c5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65d39a39-3616-40db-906b-d4327e1d63c5 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:01:31 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Successfully detached device vdb from instance 65d39a39-3616-40db-906b-d4327e1d63c5 from the live domain config.
Aug 09 23:01:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aZmAoLng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:01:31 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c2b112-a9bc-49c7-b785-dda861fb45e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b7b7b6-5d33-4ddb-ada3-8552a62387e9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:31 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:01:31 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:31 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:01:31 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:31 user nova-compute[72409]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd (non-flash)
Aug 09 23:01:31 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:31 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:01:31 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e9c3c9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6d3412-d3a4-4943-8aca-dcec7b96a060]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[61494123-89db-49fc-b6d0-06ca88bdd058]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[490ddd4c-f2de-4f0d-a9f2-fc7ac2d3c461]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec01fa87-049c-4005-8bf0-dae343e8bfcb]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b751464d-226e-425f-8a55-2b85280b8f74]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[80363493-45eb-4465-8d69-a7b076e100ca]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260]
Aug 09 23:01:31 user nova-compute[72409]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd, portal: 172.16.0.220,3260] successful.
Aug 09 23:01:31 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23978613-d1bf-48c8-b5e7-83727d93e2cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[25968171-c8de-4224-b0a7-87d01b40f426]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] <== disconnect_volume: return (340ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:01:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG nova.network.neutron [req-9a2eef7a-0338-4c2e-97a5-cb9b5031dfd4 req-4f8f304b-9c61-48b5-a106-81f459a47853 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updated VIF entry in instance network info cache for port d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG nova.network.neutron [req-9a2eef7a-0338-4c2e-97a5-cb9b5031dfd4 req-4f8f304b-9c61-48b5-a106-81f459a47853 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updating instance_info_cache with network_info: [{"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a2eef7a-0338-4c2e-97a5-cb9b5031dfd4 req-4f8f304b-9c61-48b5-a106-81f459a47853 service nova] Releasing lock "refresh_cache-65d39a39-3616-40db-906b-d4327e1d63c5" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-00b49a8d-a825-4e32-a551-26d85b31072d req-613af2bc-05d7-40ac-b245-f92fce470bde service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-00b49a8d-a825-4e32-a551-26d85b31072d req-613af2bc-05d7-40ac-b245-f92fce470bde service nova] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-00b49a8d-a825-4e32-a551-26d85b31072d req-613af2bc-05d7-40ac-b245-f92fce470bde service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-00b49a8d-a825-4e32-a551-26d85b31072d req-613af2bc-05d7-40ac-b245-f92fce470bde service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-00b49a8d-a825-4e32-a551-26d85b31072d req-613af2bc-05d7-40ac-b245-f92fce470bde service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] No waiting events found dispatching network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:01:32 user nova-compute[72409]: WARNING nova.compute.manager [req-00b49a8d-a825-4e32-a551-26d85b31072d req-613af2bc-05d7-40ac-b245-f92fce470bde service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received unexpected event network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 23:01:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-00b49a8d-a825-4e32-a551-26d85b31072d req-613af2bc-05d7-40ac-b245-f92fce470bde service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-00b49a8d-a825-4e32-a551-26d85b31072d req-613af2bc-05d7-40ac-b245-f92fce470bde service nova] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-00b49a8d-a825-4e32-a551-26d85b31072d req-613af2bc-05d7-40ac-b245-f92fce470bde service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-00b49a8d-a825-4e32-a551-26d85b31072d req-613af2bc-05d7-40ac-b245-f92fce470bde service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-00b49a8d-a825-4e32-a551-26d85b31072d req-613af2bc-05d7-40ac-b245-f92fce470bde service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] No waiting events found dispatching network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:01:32 user nova-compute[72409]: WARNING nova.compute.manager [req-00b49a8d-a825-4e32-a551-26d85b31072d req-613af2bc-05d7-40ac-b245-f92fce470bde service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received unexpected event network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 23:01:32 user nova-compute[72409]: DEBUG nova.objects.instance [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'flavor' on Instance uuid 65d39a39-3616-40db-906b-d4327e1d63c5 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ee6e3401-dc0f-4e4a-811d-30faf5c51836 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.911s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622092.9641702, 913c4e3b-f449-45fa-9ca7-3cef4b982679 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:01:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] VM Resumed (Lifecycle Event)
Aug 09 23:01:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:01:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Instance spawned successfully.
Aug 09 23:01:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:01:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:01:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:01:33 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622092.9683154, 913c4e3b-f449-45fa-9ca7-3cef4b982679 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:01:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] VM Started (Lifecycle Event)
Aug 09 23:01:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:01:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:01:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:01:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:01:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e3b0ef9-c55d-4c0e-b41a-cb4c696c8589 tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.758s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:01:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Creating image(s)
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Ensure instance console log exists: /opt/stack/data/nova/instances/4301cc62-4ca5-4b2f-bba2-0b3e0631adcf/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Start _get_guest_xml network_info=[{"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxKwgsBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4301cc62-4ca5-4b2f-bba2-0b3e0631adcf', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4fec0e3-71b7-473e-b72a-5f9656c2c15f', 'serial': 'c4fec0e3-71b7-473e-b72a-5f9656c2c15f'}, 'mount_device': '/dev/vda', 'attachment_id': '06fa0e85-5e42-42ac-9b6a-d3b3978b8907', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:01:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:01:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:01:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxKwgsBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:01:35 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:01:35 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:01:35 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[70961840-fd46-4f30-bd10-85af0c5ebce5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:01:35 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4b5212-e9be-4aae-a335-25e39407c3f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f] added
Aug 09 23:01:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6759c26c-82dd-411d-89fe-03426a03c883]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d56226-28e7-4b97-a3e6-f83875ddbdbf]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxKwgsBr {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxKwgsBr" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b486990-e065-4ade-a6fc-fa6133ee563d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yxKwgsBr'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3bb38e-137d-4f38-91f1-8cc4e0301e61]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3533703-e014-4636-929f-3fcfe4a399b8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:35 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:35 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:01:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:35 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:35 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:01:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:01:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --login" returned: 0 in 1.072s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5282e7a-df7a-4423-b277-5f6ca72e350e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260]
Aug 09 23:01:36 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260] successful.
Aug 09 23:01:36 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b01362-414a-40e5-a373-a9eeab839eba]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ddc26b-f47f-4032-9f2a-3fe927888799]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:36 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:36 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:01:36 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:01:36 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:01:36 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:01:36 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:01:36 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:01:36 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.338s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11bf78d-87d9-40fb-ae3d-61e5c5186c3c]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: None {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:01:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxKwgsBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.369s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] <== connect_volume: return (2370ms) {'type': 'block', 'scsi_wwn': '23036633462383638', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036633462383638', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1632664094',display_name='tempest-TestShelveInstance-server-1632664094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1632664094',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8NPxIW8dauNF7Cj2dKVt0Ak8JhnH+OL70iAv7fTpL5cWW4ijcYvQcbU3noSyi8gma78yFO3e+E8YR8wDg+caQC9mIfpToXrSw/VLmfImnHV2Q7bUNwF0ZUbno4ZVsuxQ==',key_name='tempest-TestShelveInstance-26576457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac38a10bc4f46f8acdca4eec503b76f',ramdisk_id='',reservation_id='r-ztardyie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-381502409',owner_user_name='tempest-TestShelveInstance-381502409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:01:20Z,user_data=None,user_id='6357af30a40c4e9ebae912eabba0bb3e',uuid=4301cc62-4ca5-4b2f-bba2-0b3e0631adcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Converting VIF {"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG nova.objects.instance [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lazy-loading 'pci_devices' on Instance uuid 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:01:37 user nova-compute[72409]:   <uuid>4301cc62-4ca5-4b2f-bba2-0b3e0631adcf</uuid>
Aug 09 23:01:37 user nova-compute[72409]:   <name>instance-0000001e</name>
Aug 09 23:01:37 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:01:37 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:01:37 user nova-compute[72409]:   <metadata>
Aug 09 23:01:37 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:01:37 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:01:37 user nova-compute[72409]:       <nova:name>tempest-TestShelveInstance-server-1632664094</nova:name>
Aug 09 23:01:37 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:01:34</nova:creationTime>
Aug 09 23:01:37 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:01:37 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:01:37 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:01:37 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:01:37 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:01:37 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:01:37 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:01:37 user nova-compute[72409]:       <nova:owner>
Aug 09 23:01:37 user nova-compute[72409]:         <nova:user uuid="6357af30a40c4e9ebae912eabba0bb3e">tempest-TestShelveInstance-381502409-project-member</nova:user>
Aug 09 23:01:37 user nova-compute[72409]:         <nova:project uuid="5ac38a10bc4f46f8acdca4eec503b76f">tempest-TestShelveInstance-381502409</nova:project>
Aug 09 23:01:37 user nova-compute[72409]:       </nova:owner>
Aug 09 23:01:37 user nova-compute[72409]:       <nova:ports>
Aug 09 23:01:37 user nova-compute[72409]:         <nova:port uuid="f26d04f1-ec38-48a6-840e-cf9d48203a37">
Aug 09 23:01:37 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 23:01:37 user nova-compute[72409]:         </nova:port>
Aug 09 23:01:37 user nova-compute[72409]:       </nova:ports>
Aug 09 23:01:37 user nova-compute[72409]:     </nova:instance>
Aug 09 23:01:37 user nova-compute[72409]:   </metadata>
Aug 09 23:01:37 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:01:37 user nova-compute[72409]:     <system>
Aug 09 23:01:37 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:01:37 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:01:37 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:01:37 user nova-compute[72409]:       <entry name="serial">4301cc62-4ca5-4b2f-bba2-0b3e0631adcf</entry>
Aug 09 23:01:37 user nova-compute[72409]:       <entry name="uuid">4301cc62-4ca5-4b2f-bba2-0b3e0631adcf</entry>
Aug 09 23:01:37 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:01:37 user nova-compute[72409]:     </system>
Aug 09 23:01:37 user nova-compute[72409]:   </sysinfo>
Aug 09 23:01:37 user nova-compute[72409]:   <os>
Aug 09 23:01:37 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:01:37 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:01:37 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:01:37 user nova-compute[72409]:   </os>
Aug 09 23:01:37 user nova-compute[72409]:   <features>
Aug 09 23:01:37 user nova-compute[72409]:     <acpi/>
Aug 09 23:01:37 user nova-compute[72409]:     <apic/>
Aug 09 23:01:37 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:01:37 user nova-compute[72409]:   </features>
Aug 09 23:01:37 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:01:37 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:01:37 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:01:37 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:01:37 user nova-compute[72409]:   </clock>
Aug 09 23:01:37 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:01:37 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:01:37 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:01:37 user nova-compute[72409]:   </cpu>
Aug 09 23:01:37 user nova-compute[72409]:   <devices>
Aug 09 23:01:37 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 23:01:37 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:01:37 user nova-compute[72409]:       <source dev="/dev/sdc"/>
Aug 09 23:01:37 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:01:37 user nova-compute[72409]:       <serial>c4fec0e3-71b7-473e-b72a-5f9656c2c15f</serial>
Aug 09 23:01:37 user nova-compute[72409]:     </disk>
Aug 09 23:01:37 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:01:37 user nova-compute[72409]:       <mac address="fa:16:3e:4b:67:e5"/>
Aug 09 23:01:37 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:01:37 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:01:37 user nova-compute[72409]:       <target dev="tapf26d04f1-ec"/>
Aug 09 23:01:37 user nova-compute[72409]:     </interface>
Aug 09 23:01:37 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:01:37 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/4301cc62-4ca5-4b2f-bba2-0b3e0631adcf/console.log" append="off"/>
Aug 09 23:01:37 user nova-compute[72409]:     </serial>
Aug 09 23:01:37 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:01:37 user nova-compute[72409]:     <video>
Aug 09 23:01:37 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:01:37 user nova-compute[72409]:     </video>
Aug 09 23:01:37 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:01:37 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:01:37 user nova-compute[72409]:     </rng>
Aug 09 23:01:37 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:01:37 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:01:37 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:01:37 user nova-compute[72409]:     </memballoon>
Aug 09 23:01:37 user nova-compute[72409]:   </devices>
Aug 09 23:01:37 user nova-compute[72409]: </domain>
Aug 09 23:01:37 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1632664094',display_name='tempest-TestShelveInstance-server-1632664094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1632664094',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8NPxIW8dauNF7Cj2dKVt0Ak8JhnH+OL70iAv7fTpL5cWW4ijcYvQcbU3noSyi8gma78yFO3e+E8YR8wDg+caQC9mIfpToXrSw/VLmfImnHV2Q7bUNwF0ZUbno4ZVsuxQ==',key_name='tempest-TestShelveInstance-26576457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac38a10bc4f46f8acdca4eec503b76f',ramdisk_id='',reservation_id='r-ztardyie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-381502409',owner_user_name='tempest-TestShelveInstance-381502409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:01:20Z,user_data=None,user_id='6357af30a40c4e9ebae912eabba0bb3e',uuid=4301cc62-4ca5-4b2f-bba2-0b3e0631adcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Converting VIF {"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG os_vif [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf26d04f1-ec, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf26d04f1-ec, col_values=(('external_ids', {'iface-id': 'f26d04f1-ec38-48a6-840e-cf9d48203a37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:67:e5', 'vm-uuid': '4301cc62-4ca5-4b2f-bba2-0b3e0631adcf'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:37 user nova-compute[72409]: INFO os_vif [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec')
Aug 09 23:01:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:01:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] No VIF found with MAC fa:16:3e:4b:67:e5, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:01:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-c36059ec-8637-4f19-97ad-80c2294a2473 req-5ad1bf92-b6d0-4604-bfa7-9a4f10325103 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c36059ec-8637-4f19-97ad-80c2294a2473 req-5ad1bf92-b6d0-4604-bfa7-9a4f10325103 service nova] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c36059ec-8637-4f19-97ad-80c2294a2473 req-5ad1bf92-b6d0-4604-bfa7-9a4f10325103 service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c36059ec-8637-4f19-97ad-80c2294a2473 req-5ad1bf92-b6d0-4604-bfa7-9a4f10325103 service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-c36059ec-8637-4f19-97ad-80c2294a2473 req-5ad1bf92-b6d0-4604-bfa7-9a4f10325103 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] No waiting events found dispatching network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:01:39 user nova-compute[72409]: WARNING nova.compute.manager [req-c36059ec-8637-4f19-97ad-80c2294a2473 req-5ad1bf92-b6d0-4604-bfa7-9a4f10325103 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received unexpected event network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 for instance with vm_state building and task_state spawning.
Aug 09 23:01:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622101.1979976, 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:01:41 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] VM Resumed (Lifecycle Event)
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:01:41 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Instance spawned successfully.
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:01:41 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622101.2023745, 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:01:41 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] VM Started (Lifecycle Event)
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:01:41 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:01:41 user nova-compute[72409]: INFO nova.compute.manager [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-dba30497-4451-4860-bc42-c6c5c3b5f02a req-c0de940f-f481-4851-ac78-fdde320be6be service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dba30497-4451-4860-bc42-c6c5c3b5f02a req-c0de940f-f481-4851-ac78-fdde320be6be service nova] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dba30497-4451-4860-bc42-c6c5c3b5f02a req-c0de940f-f481-4851-ac78-fdde320be6be service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dba30497-4451-4860-bc42-c6c5c3b5f02a req-c0de940f-f481-4851-ac78-fdde320be6be service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-dba30497-4451-4860-bc42-c6c5c3b5f02a req-c0de940f-f481-4851-ac78-fdde320be6be service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] No waiting events found dispatching network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:01:41 user nova-compute[72409]: WARNING nova.compute.manager [req-dba30497-4451-4860-bc42-c6c5c3b5f02a req-c0de940f-f481-4851-ac78-fdde320be6be service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received unexpected event network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 for instance with vm_state building and task_state spawning.
Aug 09 23:01:41 user nova-compute[72409]: INFO nova.compute.manager [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Took 22.31 seconds to build instance.
Aug 09 23:01:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f4c8a296-98cc-4c25-b324-afe4d5642187 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.433s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-51bdd88a-53fa-4938-be8c-6bb2ccc66e75 req-35599ea8-2f2b-4ff4-a215-939c47d0b255 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Received event network-changed-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:01:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-51bdd88a-53fa-4938-be8c-6bb2ccc66e75 req-35599ea8-2f2b-4ff4-a215-939c47d0b255 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Refreshing instance network info cache due to event network-changed-1ad0ad00-6090-4417-80ed-1a3fb46e6c83. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:01:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-51bdd88a-53fa-4938-be8c-6bb2ccc66e75 req-35599ea8-2f2b-4ff4-a215-939c47d0b255 service nova] Acquiring lock "refresh_cache-66750137-9d3c-476b-b21b-10032ab3d55d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:01:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-51bdd88a-53fa-4938-be8c-6bb2ccc66e75 req-35599ea8-2f2b-4ff4-a215-939c47d0b255 service nova] Acquired lock "refresh_cache-66750137-9d3c-476b-b21b-10032ab3d55d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:01:50 user nova-compute[72409]: DEBUG nova.network.neutron [req-51bdd88a-53fa-4938-be8c-6bb2ccc66e75 req-35599ea8-2f2b-4ff4-a215-939c47d0b255 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Refreshing network info cache for port 1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:01:50 user nova-compute[72409]: DEBUG nova.network.neutron [req-51bdd88a-53fa-4938-be8c-6bb2ccc66e75 req-35599ea8-2f2b-4ff4-a215-939c47d0b255 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Updated VIF entry in instance network info cache for port 1ad0ad00-6090-4417-80ed-1a3fb46e6c83. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:01:50 user nova-compute[72409]: DEBUG nova.network.neutron [req-51bdd88a-53fa-4938-be8c-6bb2ccc66e75 req-35599ea8-2f2b-4ff4-a215-939c47d0b255 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Updating instance_info_cache with network_info: [{"id": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "address": "fa:16:3e:a3:31:62", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad0ad00-60", "ovs_interfaceid": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:01:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-51bdd88a-53fa-4938-be8c-6bb2ccc66e75 req-35599ea8-2f2b-4ff4-a215-939c47d0b255 service nova] Releasing lock "refresh_cache-66750137-9d3c-476b-b21b-10032ab3d55d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:01:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:52 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:01:52 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:01:53 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:01:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:01:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:01:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:01:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:01:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:01:56 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:01:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:01:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:01:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:00 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:02:00 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=6807MB free_disk=25.20926284790039GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5b7906a3-e02b-49a3-9a56-fc34a8730238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c17c9b77-8e04-432c-9634-c4bee2eb8889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 6540903a-e102-40b3-833b-1ec5031c6d82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 65d39a39-3616-40db-906b-d4327e1d63c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c513e397-28f7-4d93-8487-257becbef9d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 66750137-9d3c-476b-b21b-10032ab3d55d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 297f364c-8f40-410a-ad2e-c56d822a757e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance f6761b27-e1f3-4f6e-a7e7-990910a3523b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 913c4e3b-f449-45fa-9ca7-3cef4b982679 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:02:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:02:01 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:02:01 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:02:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:02:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "b752ae8f-b489-4a42-a395-8c204a4298bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:02:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:01 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:02:01 user nova-compute[72409]: INFO nova.compute.claims [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Claim successful on node user
Aug 09 23:02:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:02:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:02:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:02 user nova-compute[72409]: INFO nova.virt.block_device [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Booting with volume snapshot e70d447a-c500-477e-b3cf-ec2f2816f0d7 at /dev/vda
Aug 09 23:02:02 user nova-compute[72409]: DEBUG nova.policy [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd5e2f13e0a448e836dd8684b889a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d29522bd16460eb1edc9fb7918111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updating instance_info_cache with network_info: [{"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:02:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:02:03 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Successfully created port: 8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Successfully updated port: 8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "refresh_cache-b752ae8f-b489-4a42-a395-8c204a4298bb" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquired lock "refresh_cache-b752ae8f-b489-4a42-a395-8c204a4298bb" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-f1c5cc01-9904-4f9a-bdda-a69af97918c6 req-dd663b20-1587-459c-b224-4b593ba32271 service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Received event network-changed-8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-f1c5cc01-9904-4f9a-bdda-a69af97918c6 req-dd663b20-1587-459c-b224-4b593ba32271 service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Refreshing instance network info cache due to event network-changed-8a5900fa-28ca-41a1-8e15-770437c81648. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f1c5cc01-9904-4f9a-bdda-a69af97918c6 req-dd663b20-1587-459c-b224-4b593ba32271 service nova] Acquiring lock "refresh_cache-b752ae8f-b489-4a42-a395-8c204a4298bb" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Updating instance_info_cache with network_info: [{"id": "8a5900fa-28ca-41a1-8e15-770437c81648", "address": "fa:16:3e:c7:3d:83", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5900fa-28", "ovs_interfaceid": "8a5900fa-28ca-41a1-8e15-770437c81648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Releasing lock "refresh_cache-b752ae8f-b489-4a42-a395-8c204a4298bb" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Instance network_info: |[{"id": "8a5900fa-28ca-41a1-8e15-770437c81648", "address": "fa:16:3e:c7:3d:83", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5900fa-28", "ovs_interfaceid": "8a5900fa-28ca-41a1-8e15-770437c81648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f1c5cc01-9904-4f9a-bdda-a69af97918c6 req-dd663b20-1587-459c-b224-4b593ba32271 service nova] Acquired lock "refresh_cache-b752ae8f-b489-4a42-a395-8c204a4298bb" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:02:04 user nova-compute[72409]: DEBUG nova.network.neutron [req-f1c5cc01-9904-4f9a-bdda-a69af97918c6 req-dd663b20-1587-459c-b224-4b593ba32271 service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Refreshing network info cache for port 8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:02:05 user nova-compute[72409]: DEBUG nova.network.neutron [req-f1c5cc01-9904-4f9a-bdda-a69af97918c6 req-dd663b20-1587-459c-b224-4b593ba32271 service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Updated VIF entry in instance network info cache for port 8a5900fa-28ca-41a1-8e15-770437c81648. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:02:05 user nova-compute[72409]: DEBUG nova.network.neutron [req-f1c5cc01-9904-4f9a-bdda-a69af97918c6 req-dd663b20-1587-459c-b224-4b593ba32271 service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Updating instance_info_cache with network_info: [{"id": "8a5900fa-28ca-41a1-8e15-770437c81648", "address": "fa:16:3e:c7:3d:83", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5900fa-28", "ovs_interfaceid": "8a5900fa-28ca-41a1-8e15-770437c81648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:02:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f1c5cc01-9904-4f9a-bdda-a69af97918c6 req-dd663b20-1587-459c-b224-4b593ba32271 service nova] Releasing lock "refresh_cache-b752ae8f-b489-4a42-a395-8c204a4298bb" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:02:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG os_brick.utils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c3a22a-62ed-4cdc-9e6e-2cc674b7cc5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36de204-aec2-4482-a60d-c89b1b234c9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6e8dbf-7b2b-42f5-b1f7-9c93e3896283]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd5beec-492c-43bb-8903-576492bdf3fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:02:08 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:02:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea1dbdd-8ec9-4ff1-9f6d-095b36873597]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG os_brick.utils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:02:08 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Updating existing volume attachment record: c5f3383d-f069-40eb-8853-54139780e476 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:02:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:02:17 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Creating image(s)
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Ensure instance console log exists: /opt/stack/data/nova/instances/b752ae8f-b489-4a42-a395-8c204a4298bb/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Start _get_guest_xml network_info=[{"id": "8a5900fa-28ca-41a1-8e15-770437c81648", "address": "fa:16:3e:c7:3d:83", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5900fa-28", "ovs_interfaceid": "8a5900fa-28ca-41a1-8e15-770437c81648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T23:01:52Z,direct_url=<?>,disk_format='qcow2',id=27d615ae-3499-4897-845d-9f3c25b7a51b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1726220747',owner='b6d29522bd16460eb1edc9fb7918111f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T23:01:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEGVHQUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b752ae8f-b489-4a42-a395-8c204a4298bb', 'attached_at': '', 'detached_at': '', 'volume_id': 'f47eed88-1cea-46fb-b06e-c835a88ed086', 'serial': 'f47eed88-1cea-46fb-b06e-c835a88ed086'}, 'mount_device': '/dev/vda', 'attachment_id': 'c5f3383d-f069-40eb-8853-54139780e476', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:02:17 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:02:17 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T23:01:52Z,direct_url=<?>,disk_format='qcow2',id=27d615ae-3499-4897-845d-9f3c25b7a51b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1726220747',owner='b6d29522bd16460eb1edc9fb7918111f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T23:01:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEGVHQUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:02:17 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:02:17 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:02:17 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260" returned: 21 in 0.100s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb65dabb-852a-493d-815d-ad4cff78d0a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:02:17 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[720c0b23-dbb8-409a-ab0e-c532d1c3ddea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086] added
Aug 09 23:02:17 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[634bd5b1-31fe-4961-b719-ba1ab3a1279a]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c41b0b-1e19-41f4-8e84-82be64f1ec58]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEGVHQUl {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEGVHQUl" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aba79f5-f0a1-4c04-8c5d-ed84b7dc1eaf]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sEGVHQUl'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39319be-f576-4663-91ec-ad618e3a9d7d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad08fec-24a1-4abb-acf9-34dbaa05e24c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:02:17 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:02:17 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[89117509-c4e3-4cc0-93c8-10d7d4807370]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086, portal: 172.16.0.220,3260]
Aug 09 23:02:17 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086, portal: 172.16.0.220,3260] successful.
Aug 09 23:02:17 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0282319-3ed1-4593-a376-3afdd56d5253]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c69eb0-bda8-4ca2-a43c-e0505444f30d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:02:17 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:02:17 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:02:17 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b37fd47-77ca-444e-9c31-de832bad6777]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:02:17 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEGVHQUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:02:18 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:02:18 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23530353233376565', 'path': '/dev/sde'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:02:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530353233376565', 'path': '/dev/sde'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:02:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-998004417',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-998004417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-998004417',id=31,image_ref='27d615ae-3499-4897-845d-9f3c25b7a51b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrANBkY7wekR1fw0OhanIxilHXiTaBdmQFbk25lBbMzvn7q/+fILqfcQI2zcqfZ2mMj6e6zV+qPY1fCCX8qu6XnLXCLMb42jzG8N5P44lxYW1nL8Jr1KxSRz/4xGKrg/A==',key_name='tempest-keypair-798188816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-npdo2ey2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-431608932',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=b752ae8f-b489-4a42-a395-8c204a4298bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a5900fa-28ca-41a1-8e15-770437c81648", "address": "fa:16:3e:c7:3d:83", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5900fa-28", "ovs_interfaceid": "8a5900fa-28ca-41a1-8e15-770437c81648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:02:18 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "8a5900fa-28ca-41a1-8e15-770437c81648", "address": "fa:16:3e:c7:3d:83", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5900fa-28", "ovs_interfaceid": "8a5900fa-28ca-41a1-8e15-770437c81648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:02:18 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3d:83,bridge_name='br-int',has_traffic_filtering=True,id=8a5900fa-28ca-41a1-8e15-770437c81648,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5900fa-28') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:02:18 user nova-compute[72409]: DEBUG nova.objects.instance [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lazy-loading 'pci_devices' on Instance uuid b752ae8f-b489-4a42-a395-8c204a4298bb {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:02:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:02:18 user nova-compute[72409]:   <uuid>b752ae8f-b489-4a42-a395-8c204a4298bb</uuid>
Aug 09 23:02:18 user nova-compute[72409]:   <name>instance-0000001f</name>
Aug 09 23:02:18 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:02:18 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:02:18 user nova-compute[72409]:   <metadata>
Aug 09 23:02:18 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:02:18 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:02:18 user nova-compute[72409]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-998004417</nova:name>
Aug 09 23:02:18 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:02:17</nova:creationTime>
Aug 09 23:02:18 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:02:18 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:02:18 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:02:18 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:02:18 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:02:18 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:02:18 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:02:18 user nova-compute[72409]:       <nova:owner>
Aug 09 23:02:18 user nova-compute[72409]:         <nova:user uuid="bcd5e2f13e0a448e836dd8684b889a70">tempest-TestVolumeBootPattern-431608932-project-member</nova:user>
Aug 09 23:02:18 user nova-compute[72409]:         <nova:project uuid="b6d29522bd16460eb1edc9fb7918111f">tempest-TestVolumeBootPattern-431608932</nova:project>
Aug 09 23:02:18 user nova-compute[72409]:       </nova:owner>
Aug 09 23:02:18 user nova-compute[72409]:       <nova:root type="image" uuid="27d615ae-3499-4897-845d-9f3c25b7a51b"/>
Aug 09 23:02:18 user nova-compute[72409]:       <nova:ports>
Aug 09 23:02:18 user nova-compute[72409]:         <nova:port uuid="8a5900fa-28ca-41a1-8e15-770437c81648">
Aug 09 23:02:18 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 23:02:18 user nova-compute[72409]:         </nova:port>
Aug 09 23:02:18 user nova-compute[72409]:       </nova:ports>
Aug 09 23:02:18 user nova-compute[72409]:     </nova:instance>
Aug 09 23:02:18 user nova-compute[72409]:   </metadata>
Aug 09 23:02:18 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:02:18 user nova-compute[72409]:     <system>
Aug 09 23:02:18 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:02:18 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:02:18 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:02:18 user nova-compute[72409]:       <entry name="serial">b752ae8f-b489-4a42-a395-8c204a4298bb</entry>
Aug 09 23:02:18 user nova-compute[72409]:       <entry name="uuid">b752ae8f-b489-4a42-a395-8c204a4298bb</entry>
Aug 09 23:02:18 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:02:18 user nova-compute[72409]:     </system>
Aug 09 23:02:18 user nova-compute[72409]:   </sysinfo>
Aug 09 23:02:18 user nova-compute[72409]:   <os>
Aug 09 23:02:18 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:02:18 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:02:18 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:02:18 user nova-compute[72409]:   </os>
Aug 09 23:02:18 user nova-compute[72409]:   <features>
Aug 09 23:02:18 user nova-compute[72409]:     <acpi/>
Aug 09 23:02:18 user nova-compute[72409]:     <apic/>
Aug 09 23:02:18 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:02:18 user nova-compute[72409]:   </features>
Aug 09 23:02:18 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:02:18 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:02:18 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:02:18 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:02:18 user nova-compute[72409]:   </clock>
Aug 09 23:02:18 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:02:18 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:02:18 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:02:18 user nova-compute[72409]:   </cpu>
Aug 09 23:02:18 user nova-compute[72409]:   <devices>
Aug 09 23:02:18 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 23:02:18 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:02:18 user nova-compute[72409]:       <source dev="/dev/sde"/>
Aug 09 23:02:18 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:02:18 user nova-compute[72409]:       <serial>f47eed88-1cea-46fb-b06e-c835a88ed086</serial>
Aug 09 23:02:18 user nova-compute[72409]:     </disk>
Aug 09 23:02:18 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:02:18 user nova-compute[72409]:       <mac address="fa:16:3e:c7:3d:83"/>
Aug 09 23:02:18 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:02:18 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:02:18 user nova-compute[72409]:       <target dev="tap8a5900fa-28"/>
Aug 09 23:02:18 user nova-compute[72409]:     </interface>
Aug 09 23:02:18 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:02:18 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/b752ae8f-b489-4a42-a395-8c204a4298bb/console.log" append="off"/>
Aug 09 23:02:18 user nova-compute[72409]:     </serial>
Aug 09 23:02:18 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:02:18 user nova-compute[72409]:     <video>
Aug 09 23:02:18 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:02:18 user nova-compute[72409]:     </video>
Aug 09 23:02:18 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:02:18 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:02:18 user nova-compute[72409]:     </rng>
Aug 09 23:02:18 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:02:18 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:02:18 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:02:18 user nova-compute[72409]:     </memballoon>
Aug 09 23:02:18 user nova-compute[72409]:   </devices>
Aug 09 23:02:18 user nova-compute[72409]: </domain>
Aug 09 23:02:18 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-998004417',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-998004417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-998004417',id=31,image_ref='27d615ae-3499-4897-845d-9f3c25b7a51b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrANBkY7wekR1fw0OhanIxilHXiTaBdmQFbk25lBbMzvn7q/+fILqfcQI2zcqfZ2mMj6e6zV+qPY1fCCX8qu6XnLXCLMb42jzG8N5P44lxYW1nL8Jr1KxSRz/4xGKrg/A==',key_name='tempest-keypair-798188816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-npdo2ey2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-431608932',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:02:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=b752ae8f-b489-4a42-a395-8c204a4298bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a5900fa-28ca-41a1-8e15-770437c81648", "address": "fa:16:3e:c7:3d:83", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5900fa-28", "ovs_interfaceid": "8a5900fa-28ca-41a1-8e15-770437c81648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "8a5900fa-28ca-41a1-8e15-770437c81648", "address": "fa:16:3e:c7:3d:83", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5900fa-28", "ovs_interfaceid": "8a5900fa-28ca-41a1-8e15-770437c81648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3d:83,bridge_name='br-int',has_traffic_filtering=True,id=8a5900fa-28ca-41a1-8e15-770437c81648,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5900fa-28') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG os_vif [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3d:83,bridge_name='br-int',has_traffic_filtering=True,id=8a5900fa-28ca-41a1-8e15-770437c81648,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5900fa-28') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a5900fa-28, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a5900fa-28, col_values=(('external_ids', {'iface-id': '8a5900fa-28ca-41a1-8e15-770437c81648', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:3d:83', 'vm-uuid': 'b752ae8f-b489-4a42-a395-8c204a4298bb'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:19 user nova-compute[72409]: INFO os_vif [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3d:83,bridge_name='br-int',has_traffic_filtering=True,id=8a5900fa-28ca-41a1-8e15-770437c81648,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5900fa-28')
Aug 09 23:02:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] No VIF found with MAC fa:16:3e:c7:3d:83, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "6540903a-e102-40b3-833b-1ec5031c6d82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:19 user nova-compute[72409]: INFO nova.compute.manager [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Terminating instance
Aug 09 23:02:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG nova.compute.manager [req-5e6f04ce-02d4-462a-bba7-e4f0986dbe7a req-d06af7cb-20a0-462c-8d25-b1e58ecee650 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-unplugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5e6f04ce-02d4-462a-bba7-e4f0986dbe7a req-d06af7cb-20a0-462c-8d25-b1e58ecee650 service nova] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5e6f04ce-02d4-462a-bba7-e4f0986dbe7a req-d06af7cb-20a0-462c-8d25-b1e58ecee650 service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5e6f04ce-02d4-462a-bba7-e4f0986dbe7a req-d06af7cb-20a0-462c-8d25-b1e58ecee650 service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG nova.compute.manager [req-5e6f04ce-02d4-462a-bba7-e4f0986dbe7a req-d06af7cb-20a0-462c-8d25-b1e58ecee650 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] No waiting events found dispatching network-vif-unplugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:02:19 user nova-compute[72409]: DEBUG nova.compute.manager [req-5e6f04ce-02d4-462a-bba7-e4f0986dbe7a req-d06af7cb-20a0-462c-8d25-b1e58ecee650 service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-unplugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:02:20 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Instance destroyed successfully.
Aug 09 23:02:20 user nova-compute[72409]: DEBUG nova.objects.instance [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'resources' on Instance uuid 6540903a-e102-40b3-833b-1ec5031c6d82 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-360915832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-360915832',id=21,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:58:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7dfbbb5a1d134adba458e9c592f6fada',ramdisk_id='',reservation_id='r-cwymbw5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-426575742',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:00:33Z,user_data=None,user_id='8bf771a74e994703bd1ed49add72cd14',uuid=6540903a-e102-40b3-833b-1ec5031c6d82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converting VIF {"id": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "address": "fa:16:3e:4b:b8:45", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0183f9ca-8c", "ovs_interfaceid": "0183f9ca-8c9d-4077-adfc-1d80ec039ba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=0183f9ca-8c9d-4077-adfc-1d80ec039ba4,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0183f9ca-8c') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_vif [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=0183f9ca-8c9d-4077-adfc-1d80ec039ba4,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0183f9ca-8c') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0183f9ca-8c, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:20 user nova-compute[72409]: INFO os_vif [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:b8:45,bridge_name='br-int',has_traffic_filtering=True,id=0183f9ca-8c9d-4077-adfc-1d80ec039ba4,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0183f9ca-8c')
Aug 09 23:02:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGgyDOwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:02:20 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22fda5b-9fe3-4f6c-87c1-ab24b5b55390]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b697a1-8ac6-4a98-b806-6ca18962b4d2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:02:20 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:02:20 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:02:20 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:02:20 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:02:20 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c (non-flash)
Aug 09 23:02:20 user nova-compute[72409]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:02:20 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:02:20 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:02:20 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:02:20 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e943c75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1f2986-4e56-49a2-ad48-9b2d93491142]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89a5a9b-aaae-4bc3-aad5-4cf978865078]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4d4363-8f12-4e69-852f-927d5202967f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8db87f0-1954-4f0e-9853-b19744df4f57]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8621e213-c160-473d-a2e6-739824a7389b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2563ff-c430-4b24-afa7-f353af367fc0]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c, portal: 172.16.0.220,3260]
Aug 09 23:02:20 user nova-compute[72409]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c, portal: 172.16.0.220,3260] successful.
Aug 09 23:02:20 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2415b285-e97f-4c81-b5f8-06481a7d094c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04e2a23-d282-4841-bfcd-6267e1037a37]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] <== disconnect_volume: return (323ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:02:20 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Deleting instance files /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82_del
Aug 09 23:02:20 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Deletion of /opt/stack/data/nova/instances/6540903a-e102-40b3-833b-1ec5031c6d82_del complete
Aug 09 23:02:20 user nova-compute[72409]: INFO nova.compute.manager [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Took 1.48 seconds to destroy the instance on the hypervisor.
Aug 09 23:02:20 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:02:21 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Took 0.78 seconds to deallocate network for instance.
Aug 09 23:02:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] Acquiring lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] Lock "6540903a-e102-40b3-833b-1ec5031c6d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] No waiting events found dispatching network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:02:21 user nova-compute[72409]: WARNING nova.compute.manager [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received unexpected event network-vif-plugged-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 for instance with vm_state active and task_state deleting.
Aug 09 23:02:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Received event network-vif-plugged-8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] Acquiring lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] No waiting events found dispatching network-vif-plugged-8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:02:21 user nova-compute[72409]: WARNING nova.compute.manager [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Received unexpected event network-vif-plugged-8a5900fa-28ca-41a1-8e15-770437c81648 for instance with vm_state building and task_state spawning.
Aug 09 23:02:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Received event network-vif-plugged-8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] Acquiring lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] No waiting events found dispatching network-vif-plugged-8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:02:21 user nova-compute[72409]: WARNING nova.compute.manager [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Received unexpected event network-vif-plugged-8a5900fa-28ca-41a1-8e15-770437c81648 for instance with vm_state building and task_state spawning.
Aug 09 23:02:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-17d64117-78aa-4267-ab1c-58a65e9ea86b req-98f4d659-c44d-4838-912e-143813cb4f3b service nova] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Received event network-vif-deleted-0183f9ca-8c9d-4077-adfc-1d80ec039ba4 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:02:22 user nova-compute[72409]: INFO nova.compute.manager [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Took 0.84 seconds to detach 1 volumes for instance.
Aug 09 23:02:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622142.888488, b752ae8f-b489-4a42-a395-8c204a4298bb => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:02:22 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] VM Resumed (Lifecycle Event)
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:02:22 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Instance spawned successfully.
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:02:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:02:22 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Deleted allocations for instance 6540903a-e102-40b3-833b-1ec5031c6d82
Aug 09 23:02:22 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622142.8911207, b752ae8f-b489-4a42-a395-8c204a4298bb => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:02:22 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] VM Started (Lifecycle Event)
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:02:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:02:23 user nova-compute[72409]: INFO nova.compute.manager [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Took 5.51 seconds to spawn the instance on the hypervisor.
Aug 09 23:02:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:02:23 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:02:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ef0e4d10-afa2-47e6-8dba-68a16ba2945e tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "6540903a-e102-40b3-833b-1ec5031c6d82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.726s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:23 user nova-compute[72409]: INFO nova.compute.manager [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Took 21.34 seconds to build instance.
Aug 09 23:02:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4a7f2493-5cef-4448-b618-8a0cc6e8c2a7 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.447s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:27 user nova-compute[72409]: INFO nova.compute.manager [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Terminating instance
Aug 09 23:02:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:02:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-316af551-c825-4fb7-90e8-95f3b58db994 req-aac6e770-d62d-4afa-84f0-f0fbf95660dd service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-vif-unplugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-316af551-c825-4fb7-90e8-95f3b58db994 req-aac6e770-d62d-4afa-84f0-f0fbf95660dd service nova] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-316af551-c825-4fb7-90e8-95f3b58db994 req-aac6e770-d62d-4afa-84f0-f0fbf95660dd service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-316af551-c825-4fb7-90e8-95f3b58db994 req-aac6e770-d62d-4afa-84f0-f0fbf95660dd service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-316af551-c825-4fb7-90e8-95f3b58db994 req-aac6e770-d62d-4afa-84f0-f0fbf95660dd service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] No waiting events found dispatching network-vif-unplugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-316af551-c825-4fb7-90e8-95f3b58db994 req-aac6e770-d62d-4afa-84f0-f0fbf95660dd service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-vif-unplugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:02:28 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Instance destroyed successfully.
Aug 09 23:02:28 user nova-compute[72409]: DEBUG nova.objects.instance [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'resources' on Instance uuid 65d39a39-3616-40db-906b-d4327e1d63c5 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:57:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1412508005',display_name='tempest-TestMinimumBasicScenario-server-1412508005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1412508005',id=23,image_ref='c98b41c3-c55f-4611-b915-f71a20d77fa8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHNfX9MWZkMyzioX/sWVa4s+rtfVlh+5vlMYHbjyIYluYUUgKRn1OlJBpE2A4bNlZRpcJprB0f1Qwc07KLZ2pODQGZBILXeMZIeBIyMkusp4+aJ6bbTIINp1QC0dSUmgQ==',key_name='tempest-TestMinimumBasicScenario-1519007605',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:57:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fb0e0790757422da3f43722e4bd554e',ramdisk_id='',reservation_id='r-uxli3rx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c98b41c3-c55f-4611-b915-f71a20d77fa8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1632899528',owner_user_name='tempest-TestMinimumBasicScenario-1632899528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:59:45Z,user_data=None,user_id='8411ad4a2fdd412783da8516d860cccb',uuid=65d39a39-3616-40db-906b-d4327e1d63c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converting VIF {"id": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "address": "fa:16:3e:04:8a:27", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fb0a70-5e", "ovs_interfaceid": "d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG os_vif [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8fb0a70-5e, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:28 user nova-compute[72409]: INFO os_vif [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:8a:27,bridge_name='br-int',has_traffic_filtering=True,id=d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fb0a70-5e')
Aug 09 23:02:28 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Deleting instance files /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5_del
Aug 09 23:02:28 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Deletion of /opt/stack/data/nova/instances/65d39a39-3616-40db-906b-d4327e1d63c5_del complete
Aug 09 23:02:28 user nova-compute[72409]: INFO nova.compute.manager [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 23:02:28 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:02:28 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:02:29 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:02:29 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Took 0.56 seconds to deallocate network for instance.
Aug 09 23:02:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:29 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:02:29 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:02:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:29 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Deleted allocations for instance 65d39a39-3616-40db-906b-d4327e1d63c5
Aug 09 23:02:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-501c7a02-76f0-4202-b52b-3a879d492401 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "65d39a39-3616-40db-906b-d4327e1d63c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.070s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-e9f38a23-2619-4207-930f-81525938ac3d req-1f9d1ccc-2f3a-48dc-9694-a6bac588a380 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:02:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e9f38a23-2619-4207-930f-81525938ac3d req-1f9d1ccc-2f3a-48dc-9694-a6bac588a380 service nova] Acquiring lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e9f38a23-2619-4207-930f-81525938ac3d req-1f9d1ccc-2f3a-48dc-9694-a6bac588a380 service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e9f38a23-2619-4207-930f-81525938ac3d req-1f9d1ccc-2f3a-48dc-9694-a6bac588a380 service nova] Lock "65d39a39-3616-40db-906b-d4327e1d63c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-e9f38a23-2619-4207-930f-81525938ac3d req-1f9d1ccc-2f3a-48dc-9694-a6bac588a380 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] No waiting events found dispatching network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:02:30 user nova-compute[72409]: WARNING nova.compute.manager [req-e9f38a23-2619-4207-930f-81525938ac3d req-1f9d1ccc-2f3a-48dc-9694-a6bac588a380 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received unexpected event network-vif-plugged-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d for instance with vm_state deleted and task_state None.
Aug 09 23:02:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-e9f38a23-2619-4207-930f-81525938ac3d req-1f9d1ccc-2f3a-48dc-9694-a6bac588a380 service nova] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Received event network-vif-deleted-d8fb0a70-5e4c-4bc0-aac8-5c0993f2ac7d {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:02:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:35 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622140.34654, 6540903a-e102-40b3-833b-1ec5031c6d82 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:02:35 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] VM Stopped (Lifecycle Event)
Aug 09 23:02:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-84387f68-611c-45be-b793-1fbf6318e726 None None] [instance: 6540903a-e102-40b3-833b-1ec5031c6d82] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-05c791b7-6038-44cd-994d-1cb590d2721c req-a88ec0ad-9412-410c-81d1-730efaea3502 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Received event network-changed-e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-05c791b7-6038-44cd-994d-1cb590d2721c req-a88ec0ad-9412-410c-81d1-730efaea3502 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Refreshing instance network info cache due to event network-changed-e60933af-9d7b-4f1d-bfbc-c202db40a783. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05c791b7-6038-44cd-994d-1cb590d2721c req-a88ec0ad-9412-410c-81d1-730efaea3502 service nova] Acquiring lock "refresh_cache-297f364c-8f40-410a-ad2e-c56d822a757e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05c791b7-6038-44cd-994d-1cb590d2721c req-a88ec0ad-9412-410c-81d1-730efaea3502 service nova] Acquired lock "refresh_cache-297f364c-8f40-410a-ad2e-c56d822a757e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG nova.network.neutron [req-05c791b7-6038-44cd-994d-1cb590d2721c req-a88ec0ad-9412-410c-81d1-730efaea3502 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Refreshing network info cache for port e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "297f364c-8f40-410a-ad2e-c56d822a757e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "297f364c-8f40-410a-ad2e-c56d822a757e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lazy-loading 'flavor' on Instance uuid 297f364c-8f40-410a-ad2e-c56d822a757e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:02:37 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Ignoring supplied device name: /dev/vdb
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "297f364c-8f40-410a-ad2e-c56d822a757e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "297f364c-8f40-410a-ad2e-c56d822a757e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "297f364c-8f40-410a-ad2e-c56d822a757e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:37 user nova-compute[72409]: INFO nova.compute.manager [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Attaching volume 4c1631fb-8092-4af5-a118-cb0689ab1517 to /dev/vdb
Aug 09 23:02:37 user nova-compute[72409]: DEBUG nova.network.neutron [req-05c791b7-6038-44cd-994d-1cb590d2721c req-a88ec0ad-9412-410c-81d1-730efaea3502 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Updated VIF entry in instance network info cache for port e60933af-9d7b-4f1d-bfbc-c202db40a783. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG nova.network.neutron [req-05c791b7-6038-44cd-994d-1cb590d2721c req-a88ec0ad-9412-410c-81d1-730efaea3502 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Updating instance_info_cache with network_info: [{"id": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "address": "fa:16:3e:2a:f7:e9", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60933af-9d", "ovs_interfaceid": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG os_brick.utils [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05c791b7-6038-44cd-994d-1cb590d2721c req-a88ec0ad-9412-410c-81d1-730efaea3502 service nova] Releasing lock "refresh_cache-297f364c-8f40-410a-ad2e-c56d822a757e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[30417a7d-b0f8-464b-a553-fc91679aff77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35963a6-95ad-47e9-96f0-5e96f7e6e5e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb25ecc-3df8-413a-adda-4be60fde9d44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdcfee2-1369-4f8e-aabc-47ee86422fea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:02:37 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:02:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d013ca-213d-400d-9645-17635c8d9273]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG os_brick.utils [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:02:37 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Updating existing volume attachment record: 3df02d3b-ed7e-4acc-8da2-b800d85d1da5 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:02:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:02:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:43 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622148.6822898, 65d39a39-3616-40db-906b-d4327e1d63c5 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:02:43 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] VM Stopped (Lifecycle Event)
Aug 09 23:02:43 user nova-compute[72409]: DEBUG nova.compute.manager [None req-61a331c5-146f-4ca1-bf0b-348b9fb25359 None None] [instance: 65d39a39-3616-40db-906b-d4327e1d63c5] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:02:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:02:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irKGLjSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:02:46 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:02:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:02:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:02:46 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:02:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:02:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:02:46 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:02:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e4101d-750f-4804-9e14-b940145718b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:02:46 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[14be1fd3-5aa6-49a4-a38b-ce43814d8222]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517] added
Aug 09 23:02:47 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[424d2eb8-f542-476f-b3f4-19c44ca680cb]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5789382-d3d8-4731-9a53-f07ed5ad51fc]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irKGLjSu {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irKGLjSu" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff2e188-2abf-49f9-943f-0666ebf3c907]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'irKGLjSu'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ace8e59-a37a-4681-8618-506115792bc4]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[352564bb-e950-4367-a422-47f8f7114be4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ac8436-e225-4ce8-acc4-029c8a8ed1f3 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ac8436-e225-4ce8-acc4-029c8a8ed1f3 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ac8436-e225-4ce8-acc4-029c8a8ed1f3 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5a02ca-e30e-4aa7-b25d-4220adb581cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517, portal: 172.16.0.220,3260]
Aug 09 23:02:47 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517, portal: 172.16.0.220,3260] successful.
Aug 09 23:02:47 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c581c5-93ea-4f9a-80e2-8a6021608eaf]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a0e9b4-7ffc-4ee1-aa6c-1adf9d88d7c0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ac8436-e225-4ce8-acc4-029c8a8ed1f3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ac8436-e225-4ce8-acc4-029c8a8ed1f3 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47ac8436-e225-4ce8-acc4-029c8a8ed1f3 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:02:47 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a746bc0-539e-4b81-9d2e-60a54b305e76]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:02:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irKGLjSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:02:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:02:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26237356636393739', 'path': '/dev/sdg'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:02:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237356636393739', 'path': '/dev/sdg'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:02:48 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lazy-loading 'flavor' on Instance uuid 297f364c-8f40-410a-ad2e-c56d822a757e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:02:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:02:48 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:02:48 user nova-compute[72409]:   <source dev="/dev/sdg"/>
Aug 09 23:02:48 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:02:48 user nova-compute[72409]:   <serial>4c1631fb-8092-4af5-a118-cb0689ab1517</serial>
Aug 09 23:02:48 user nova-compute[72409]: </disk>
Aug 09 23:02:48 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:02:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:02:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:02:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] No VIF found with MAC fa:16:3e:2a:f7:e9, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:02:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8379e456-f6d9-4e21-bf38-4880c5957025 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "297f364c-8f40-410a-ad2e-c56d822a757e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.107s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-ad740346-3643-4e81-98b5-e64388e8a566 req-b1a36a34-b7e9-4e7c-a2fa-168ce199bbc5 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Received event network-changed-94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:02:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-ad740346-3643-4e81-98b5-e64388e8a566 req-b1a36a34-b7e9-4e7c-a2fa-168ce199bbc5 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Refreshing instance network info cache due to event network-changed-94290ac9-5002-469d-babb-28d9d4adbaba. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:02:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ad740346-3643-4e81-98b5-e64388e8a566 req-b1a36a34-b7e9-4e7c-a2fa-168ce199bbc5 service nova] Acquiring lock "refresh_cache-f6761b27-e1f3-4f6e-a7e7-990910a3523b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:02:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ad740346-3643-4e81-98b5-e64388e8a566 req-b1a36a34-b7e9-4e7c-a2fa-168ce199bbc5 service nova] Acquired lock "refresh_cache-f6761b27-e1f3-4f6e-a7e7-990910a3523b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:02:51 user nova-compute[72409]: DEBUG nova.network.neutron [req-ad740346-3643-4e81-98b5-e64388e8a566 req-b1a36a34-b7e9-4e7c-a2fa-168ce199bbc5 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Refreshing network info cache for port 94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:02:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG nova.network.neutron [req-ad740346-3643-4e81-98b5-e64388e8a566 req-b1a36a34-b7e9-4e7c-a2fa-168ce199bbc5 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Updated VIF entry in instance network info cache for port 94290ac9-5002-469d-babb-28d9d4adbaba. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG nova.network.neutron [req-ad740346-3643-4e81-98b5-e64388e8a566 req-b1a36a34-b7e9-4e7c-a2fa-168ce199bbc5 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Updating instance_info_cache with network_info: [{"id": "94290ac9-5002-469d-babb-28d9d4adbaba", "address": "fa:16:3e:ac:30:2c", "network": {"id": "4ce575ab-a977-48a1-a305-3b5df321a3d3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1866075743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02446693acb409e81e2484a006ec6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94290ac9-50", "ovs_interfaceid": "94290ac9-5002-469d-babb-28d9d4adbaba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ad740346-3643-4e81-98b5-e64388e8a566 req-b1a36a34-b7e9-4e7c-a2fa-168ce199bbc5 service nova] Releasing lock "refresh_cache-f6761b27-e1f3-4f6e-a7e7-990910a3523b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lazy-loading 'flavor' on Instance uuid f6761b27-e1f3-4f6e-a7e7-990910a3523b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:52 user nova-compute[72409]: INFO nova.compute.manager [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Attaching volume 7271554e-2bd9-4b8e-831c-c59be7989002 to /dev/vdb
Aug 09 23:02:52 user nova-compute[72409]: DEBUG os_brick.utils [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e7b44e-b076-47c1-9dda-317eca12a45f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc1db98-853b-407c-8268-bdf0465b1ca4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[40db7111-37e3-43dc-a1ee-10674035c213]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb06b2f6-ff27-420c-a789-86af45425234]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:02:52 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c1018f-3b0a-4757-bdc4-5d95287a6d71]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG os_brick.utils [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Updating existing volume attachment record: 97729797-2ad0-4b92-986c-a524104de84b {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:02:52 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:02:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:53 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:02:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:02:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:02:58 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:02:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:02:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:02:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:02:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:02:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:02:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:02:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:02:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:03:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:02 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:03:02 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=6921MB free_disk=25.225250244140625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5b7906a3-e02b-49a3-9a56-fc34a8730238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c17c9b77-8e04-432c-9634-c4bee2eb8889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c513e397-28f7-4d93-8487-257becbef9d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 66750137-9d3c-476b-b21b-10032ab3d55d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 297f364c-8f40-410a-ad2e-c56d822a757e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance f6761b27-e1f3-4f6e-a7e7-990910a3523b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 913c4e3b-f449-45fa-9ca7-3cef4b982679 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance b752ae8f-b489-4a42-a395-8c204a4298bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:03:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:03 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:03:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:03:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-c17c9b77-8e04-432c-9634-c4bee2eb8889" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:03:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-c17c9b77-8e04-432c-9634-c4bee2eb8889" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:03:03 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:03:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Updating instance_info_cache with network_info: [{"id": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "address": "fa:16:3e:a6:51:84", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb543e82-69", "ovs_interfaceid": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-c17c9b77-8e04-432c-9634-c4bee2eb8889" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:03:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:03:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:03:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:03:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:03:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:03:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:03:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:03:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:08 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:03:08 user nova-compute[72409]: INFO nova.compute.claims [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Claim successful on node user
Aug 09 23:03:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:08 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:03:08 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:03:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.743s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:03:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:03:08 user nova-compute[72409]: DEBUG nova.network.neutron [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:03:08 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:03:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:03:09 user nova-compute[72409]: INFO nova.virt.block_device [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Booting with volume cced161b-4fe6-4c99-942c-06f01605ef89 at /dev/vda
Aug 09 23:03:09 user nova-compute[72409]: DEBUG nova.policy [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efd76f1c0d9b42269fcc69f24c9f59e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7e3f592e7141659581ae7f67c6af43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG os_brick.utils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[95882963-c058-4b44-8344-c062a61d0935]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[425a1f17-5ed3-4038-9ee0-7818dea690de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ef8206-2368-438b-a855-c9d3398e24fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a579d4-6b50-4bc7-8431-b135ceae7717]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:03:09 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:03:09 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb8b259-24d1-4ee3-b1c1-107312147821]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG os_brick.utils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updating existing volume attachment record: 810b8246-ad56-4876-9b96-e0796fa18995 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:09 user nova-compute[72409]: DEBUG nova.network.neutron [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Successfully created port: b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "5b7906a3-e02b-49a3-9a56-fc34a8730238" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:10 user nova-compute[72409]: INFO nova.compute.manager [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Terminating instance
Aug 09 23:03:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-112d97f8-33f8-40f2-acda-9451963aeee8 req-a46e0ebe-b4f0-484b-b385-b6fac3a092e1 service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Received event network-vif-unplugged-a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-112d97f8-33f8-40f2-acda-9451963aeee8 req-a46e0ebe-b4f0-484b-b385-b6fac3a092e1 service nova] Acquiring lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-112d97f8-33f8-40f2-acda-9451963aeee8 req-a46e0ebe-b4f0-484b-b385-b6fac3a092e1 service nova] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-112d97f8-33f8-40f2-acda-9451963aeee8 req-a46e0ebe-b4f0-484b-b385-b6fac3a092e1 service nova] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-112d97f8-33f8-40f2-acda-9451963aeee8 req-a46e0ebe-b4f0-484b-b385-b6fac3a092e1 service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] No waiting events found dispatching network-vif-unplugged-a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-112d97f8-33f8-40f2-acda-9451963aeee8 req-a46e0ebe-b4f0-484b-b385-b6fac3a092e1 service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Received event network-vif-unplugged-a3239f85-cc45-49f5-97a6-b936267579a8 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:03:10 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Instance destroyed successfully.
Aug 09 23:03:10 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'resources' on Instance uuid 5b7906a3-e02b-49a3-9a56-fc34a8730238 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:53:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-263758231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-263758231',id=14,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:53:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7dfbbb5a1d134adba458e9c592f6fada',ramdisk_id='',reservation_id='r-kp0kahcr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-426575742',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:55:44Z,user_data=None,user_id='8bf771a74e994703bd1ed49add72cd14',uuid=5b7906a3-e02b-49a3-9a56-fc34a8730238,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3239f85-cc45-49f5-97a6-b936267579a8", "address": "fa:16:3e:00:16:76", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3239f85-cc", "ovs_interfaceid": "a3239f85-cc45-49f5-97a6-b936267579a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converting VIF {"id": "a3239f85-cc45-49f5-97a6-b936267579a8", "address": "fa:16:3e:00:16:76", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3239f85-cc", "ovs_interfaceid": "a3239f85-cc45-49f5-97a6-b936267579a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:16:76,bridge_name='br-int',has_traffic_filtering=True,id=a3239f85-cc45-49f5-97a6-b936267579a8,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3239f85-cc') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG os_vif [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:16:76,bridge_name='br-int',has_traffic_filtering=True,id=a3239f85-cc45-49f5-97a6-b936267579a8,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3239f85-cc') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3239f85-cc, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:03:10 user nova-compute[72409]: INFO os_vif [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:16:76,bridge_name='br-int',has_traffic_filtering=True,id=a3239f85-cc45-49f5-97a6-b936267579a8,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3239f85-cc')
Aug 09 23:03:10 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Deleting instance files /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238_del
Aug 09 23:03:10 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Deletion of /opt/stack/data/nova/instances/5b7906a3-e02b-49a3-9a56-fc34a8730238_del complete
Aug 09 23:03:11 user nova-compute[72409]: INFO nova.compute.manager [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 23:03:11 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:03:11 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:03:11 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:03:11 user nova-compute[72409]: DEBUG nova.network.neutron [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Successfully updated port: b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:03:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:03:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquired lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:03:11 user nova-compute[72409]: DEBUG nova.network.neutron [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:03:11 user nova-compute[72409]: DEBUG nova.network.neutron [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:03:11 user nova-compute[72409]: DEBUG nova.network.neutron [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updating instance_info_cache with network_info: [{"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Releasing lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:03:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Instance network_info: |[{"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:03:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:11 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:11 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Took 0.94 seconds to deallocate network for instance.
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:12 user nova-compute[72409]: INFO nova.compute.manager [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Terminating instance
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-1b72f1ef-a36f-4a25-b993-7132eb5a260c req-821c44ad-16ce-4a1b-a2b9-07a309dc2198 service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Received event network-vif-deleted-a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:12 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Deleted allocations for instance 5b7906a3-e02b-49a3-9a56-fc34a8730238
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:12 user nova-compute[72409]: INFO nova.compute.manager [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Shelve offloading
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2d46899b-ee13-46c3-8ae5-f8c55f1036ab tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.521s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Received event network-vif-plugged-a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] Acquiring lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] Lock "5b7906a3-e02b-49a3-9a56-fc34a8730238-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] No waiting events found dispatching network-vif-plugged-a3239f85-cc45-49f5-97a6-b936267579a8 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:12 user nova-compute[72409]: WARNING nova.compute.manager [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Received unexpected event network-vif-plugged-a3239f85-cc45-49f5-97a6-b936267579a8 for instance with vm_state deleted and task_state None.
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received event network-changed-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Refreshing instance network info cache due to event network-changed-b699c9c4-31f5-41b2-ac73-16353dceb256. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] Acquiring lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] Acquired lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.network.neutron [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Refreshing network info cache for port b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:03:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Instance destroyed successfully.
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.objects.instance [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lazy-loading 'resources' on Instance uuid 913c4e3b-f449-45fa-9ca7-3cef4b982679 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T22:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1373843419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1373843419',id=25,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC1hhBxaz7viONyIT9RsHBrWO2Zdg8jzhxEhHD5WrF5eHR/YWIq5aFc8ycg7RekfFI/PdlohcnFbJxcfXXvCNSOh0Z5bDeIh5g1vM6vUGxs6yI1wQi6EYyidFxqU62AkA==',key_name='tempest-keypair-656104974',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:01:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='894e6764aa794ff29ce4bc213a7def7d',ramdisk_id='',reservation_id='r-0g99dck8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-723310053',owner_user_name='tempest-AttachVolumeShelveTestJSON-723310053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce008676a8de41b8b2ffe79ab31462df',uuid=913c4e3b-f449-45fa-9ca7-3cef4b982679,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converting VIF {"id": "a80bd290-a75e-4702-b917-3319bee30a60", "address": "fa:16:3e:cf:69:56", "network": {"id": "1738536c-a95b-4baa-93b5-fa8d5ff3e8d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1869914462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894e6764aa794ff29ce4bc213a7def7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa80bd290-a7", "ovs_interfaceid": "a80bd290-a75e-4702-b917-3319bee30a60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG os_vif [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa80bd290-a7, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:12 user nova-compute[72409]: INFO os_vif [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:69:56,bridge_name='br-int',has_traffic_filtering=True,id=a80bd290-a75e-4702-b917-3319bee30a60,network=Network(1738536c-a95b-4baa-93b5-fa8d5ff3e8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa80bd290-a7')
Aug 09 23:03:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Deleting instance files /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679_del
Aug 09 23:03:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Deletion of /opt/stack/data/nova/instances/913c4e3b-f449-45fa-9ca7-3cef4b982679_del complete
Aug 09 23:03:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:12 user nova-compute[72409]: INFO nova.compute.manager [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 23:03:12 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:03:12 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-c3e14384-4721-4399-96cb-3289a2a8552c req-5c343da4-bc02-4388-9d43-22cd03b71f8d service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-vif-unplugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c3e14384-4721-4399-96cb-3289a2a8552c req-5c343da4-bc02-4388-9d43-22cd03b71f8d service nova] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c3e14384-4721-4399-96cb-3289a2a8552c req-5c343da4-bc02-4388-9d43-22cd03b71f8d service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c3e14384-4721-4399-96cb-3289a2a8552c req-5c343da4-bc02-4388-9d43-22cd03b71f8d service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-c3e14384-4721-4399-96cb-3289a2a8552c req-5c343da4-bc02-4388-9d43-22cd03b71f8d service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] No waiting events found dispatching network-vif-unplugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:13 user nova-compute[72409]: WARNING nova.compute.manager [req-c3e14384-4721-4399-96cb-3289a2a8552c req-5c343da4-bc02-4388-9d43-22cd03b71f8d service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received unexpected event network-vif-unplugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 for instance with vm_state active and task_state shelving.
Aug 09 23:03:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdErbWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:03:13 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:03:13 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:03:13 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d650425d-d616-4110-844a-b7c407b5606a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:03:13 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG nova.network.neutron [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updated VIF entry in instance network info cache for port b699c9c4-31f5-41b2-ac73-16353dceb256. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG nova.network.neutron [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updating instance_info_cache with network_info: [{"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f08235b-d47a-4275-a2dd-d415eac8ca0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002] added
Aug 09 23:03:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-30615299-c1e9-42ac-a534-b0c8b7d08e2a req-a7fdcfdc-38de-421d-8e90-8124334d22cb service nova] Releasing lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5581d962-b7ba-4b6c-b7e7-266b27cb056f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ad62ab-3bc4-4e2a-aa90-0826a4b91f96]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXdErbWi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXdErbWi" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf104683-f354-4f51-a9b1-42e4f7f93c93]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gXdErbWi'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d286c826-2e25-4848-b444-70d5e071ec0f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cd261a-534c-4e2c-b827-61f9ec892559]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:13 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Instance destroyed successfully.
Aug 09 23:03:13 user nova-compute[72409]: DEBUG nova.compute.manager [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquired lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG nova.network.neutron [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9b4e7e-e141-48fd-bfb8-03771f27f183]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002, portal: 172.16.0.220,3260]
Aug 09 23:03:13 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002, portal: 172.16.0.220,3260] successful.
Aug 09 23:03:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.096s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eba4f6a-6752-4067-988d-145454eb8f49]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[720f627a-b7a1-4cfb-ac85-00cfbc47b110]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[975cdc3c-d2f1-4b22-871f-b44bdb98fa28]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:03:13 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:13 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Took 1.03 seconds to deallocate network for instance.
Aug 09 23:03:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-changed-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Refreshing instance network info cache due to event network-changed-f26d04f1-ec38-48a6-840e-cf9d48203a37. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] Acquiring lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:14 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Deleted allocations for instance 913c4e3b-f449-45fa-9ca7-3cef4b982679
Aug 09 23:03:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-54bdcf3b-4f26-4e5c-bc50-b94a23a4ab8d tempest-AttachVolumeShelveTestJSON-723310053 tempest-AttachVolumeShelveTestJSON-723310053-project-member] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.607s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updating instance_info_cache with network_info: [{"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Releasing lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] Acquired lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG nova.network.neutron [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Refreshing network info cache for port f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdErbWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '26262383335306164', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262383335306164', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-d7677fc8-e8d3-4d90-9265-eb202ac84c00 req-a132e673-569e-409d-b5f6-7541663020b5 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-vif-deleted-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lazy-loading 'flavor' on Instance uuid f6761b27-e1f3-4f6e-a7e7-990910a3523b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:03:14 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:03:14 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:03:14 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:03:14 user nova-compute[72409]:   <serial>7271554e-2bd9-4b8e-831c-c59be7989002</serial>
Aug 09 23:03:14 user nova-compute[72409]: </disk>
Aug 09 23:03:14 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.network.neutron [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updated VIF entry in instance network info cache for port f26d04f1-ec38-48a6-840e-cf9d48203a37. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.network.neutron [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updating instance_info_cache with network_info: [{"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] Releasing lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-vif-unplugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] No waiting events found dispatching network-vif-unplugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:15 user nova-compute[72409]: WARNING nova.compute.manager [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received unexpected event network-vif-unplugged-a80bd290-a75e-4702-b917-3319bee30a60 for instance with vm_state deleted and task_state None.
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received event network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] Acquiring lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] Lock "913c4e3b-f449-45fa-9ca7-3cef4b982679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] No waiting events found dispatching network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:15 user nova-compute[72409]: WARNING nova.compute.manager [req-06313393-7d79-403a-8130-ef3509556480 req-00bd9734-b4c0-43b6-a763-60331eebf8f9 service nova] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Received unexpected event network-vif-plugged-a80bd290-a75e-4702-b917-3319bee30a60 for instance with vm_state deleted and task_state None.
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] No VIF found with MAC fa:16:3e:ac:30:2c, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-862177e7-2731-44b3-bbc5-62b6fcd7b501 req-6456d5bd-205b-4ddd-918a-f53444874d81 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-862177e7-2731-44b3-bbc5-62b6fcd7b501 req-6456d5bd-205b-4ddd-918a-f53444874d81 service nova] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-862177e7-2731-44b3-bbc5-62b6fcd7b501 req-6456d5bd-205b-4ddd-918a-f53444874d81 service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-862177e7-2731-44b3-bbc5-62b6fcd7b501 req-6456d5bd-205b-4ddd-918a-f53444874d81 service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-862177e7-2731-44b3-bbc5-62b6fcd7b501 req-6456d5bd-205b-4ddd-918a-f53444874d81 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] No waiting events found dispatching network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:15 user nova-compute[72409]: WARNING nova.compute.manager [req-862177e7-2731-44b3-bbc5-62b6fcd7b501 req-6456d5bd-205b-4ddd-918a-f53444874d81 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received unexpected event network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 for instance with vm_state active and task_state shelving.
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9c7714c2-f39e-411c-9846-dd6dde325f17 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.864s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:15 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Instance destroyed successfully.
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.objects.instance [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lazy-loading 'resources' on Instance uuid 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1632664094',display_name='tempest-TestShelveInstance-server-1632664094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1632664094',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8NPxIW8dauNF7Cj2dKVt0Ak8JhnH+OL70iAv7fTpL5cWW4ijcYvQcbU3noSyi8gma78yFO3e+E8YR8wDg+caQC9mIfpToXrSw/VLmfImnHV2Q7bUNwF0ZUbno4ZVsuxQ==',key_name='tempest-TestShelveInstance-26576457',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:01:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ac38a10bc4f46f8acdca4eec503b76f',ramdisk_id='',reservation_id='r-ztardyie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-381502409',owner_user_name='tempest-TestShelveInstance-381502409-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:01:41Z,user_data=None,user_id='6357af30a40c4e9ebae912eabba0bb3e',uuid=4301cc62-4ca5-4b2f-bba2-0b3e0631adcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Converting VIF {"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_vif [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf26d04f1-ec, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:15 user nova-compute[72409]: INFO os_vif [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec')
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxKwgsBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:03:15 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b98a212-28f7-497a-ba4d-88debe4aa539]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72a6a70-c0e2-4ff9-be9b-0dd75a4cfb87]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:15 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:15 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:03:15 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:15 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:15 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:15 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:15 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:15 user nova-compute[72409]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:03:15 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:15 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:15 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:15 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e94383490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fc144c-07bd-4e91-98a2-b984d2f42373]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a974eb2-0199-4626-9c0d-3be59e09811a]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04d92d7-6127-463d-a4bd-d0759f922ec8]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c6ffcf-fb65-47bc-9254-e7968feee19f]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba26022-023c-436b-bb02-0cb90d3743c4]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edbf094-67bf-4682-a1cf-0afeaaf9db49]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260]
Aug 09 23:03:15 user nova-compute[72409]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260] successful.
Aug 09 23:03:15 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f40f282-6ac6-4c70-852b-8a8a17663e91]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] <== disconnect_volume: return (323ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:03:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:03:15 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Deleting instance files /opt/stack/data/nova/instances/4301cc62-4ca5-4b2f-bba2-0b3e0631adcf_del
Aug 09 23:03:15 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Deletion of /opt/stack/data/nova/instances/4301cc62-4ca5-4b2f-bba2-0b3e0631adcf_del complete
Aug 09 23:03:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-d5049641-188d-4f37-89bb-afec48ae3b4d req-d4ee80cd-977d-4f34-996b-c73933fb89f6 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-changed-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-d5049641-188d-4f37-89bb-afec48ae3b4d req-d4ee80cd-977d-4f34-996b-c73933fb89f6 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Refreshing instance network info cache due to event network-changed-f26d04f1-ec38-48a6-840e-cf9d48203a37. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:03:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d5049641-188d-4f37-89bb-afec48ae3b4d req-d4ee80cd-977d-4f34-996b-c73933fb89f6 service nova] Acquiring lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:03:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d5049641-188d-4f37-89bb-afec48ae3b4d req-d4ee80cd-977d-4f34-996b-c73933fb89f6 service nova] Acquired lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:03:16 user nova-compute[72409]: DEBUG nova.network.neutron [req-d5049641-188d-4f37-89bb-afec48ae3b4d req-d4ee80cd-977d-4f34-996b-c73933fb89f6 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Refreshing network info cache for port f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:03:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:16 user nova-compute[72409]: DEBUG nova.network.neutron [req-d5049641-188d-4f37-89bb-afec48ae3b4d req-d4ee80cd-977d-4f34-996b-c73933fb89f6 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updated VIF entry in instance network info cache for port f26d04f1-ec38-48a6-840e-cf9d48203a37. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:03:16 user nova-compute[72409]: DEBUG nova.network.neutron [req-d5049641-188d-4f37-89bb-afec48ae3b4d req-d4ee80cd-977d-4f34-996b-c73933fb89f6 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updating instance_info_cache with network_info: [{"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": null, "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d5049641-188d-4f37-89bb-afec48ae3b4d req-d4ee80cd-977d-4f34-996b-c73933fb89f6 service nova] Releasing lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG nova.objects.instance [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lazy-loading 'flavor' on Instance uuid f6761b27-e1f3-4f6e-a7e7-990910a3523b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.005s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:19 user nova-compute[72409]: INFO nova.compute.manager [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Attaching volume bc946993-b59b-462d-aa07-d2349d846c86 to /dev/vdc
Aug 09 23:03:19 user nova-compute[72409]: DEBUG os_brick.utils [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c06358-e67a-4ac0-abfc-0dcba790ca05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcaeabf-d7ec-461d-8b52-033cd5da4552]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d38c408-fc9f-4235-9ad8-3243b655b46e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4008c37-18eb-444d-85b7-af12b071b4ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:03:19 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:03:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[34591997-4553-4b2c-8ba7-f1b979abbf14]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG os_brick.utils [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:03:19 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Updating existing volume attachment record: 68ddd239-4cbf-4e7b-a0b3-32dd1a399d9f {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:03:20 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Creating image(s)
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Ensure instance console log exists: /opt/stack/data/nova/instances/b0c67c33-9d1a-4479-a64f-8f867330b9dc/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Start _get_guest_xml network_info=[{"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxmNSztl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0c67c33-9d1a-4479-a64f-8f867330b9dc', 'attached_at': '', 'detached_at': '', 'volume_id': 'cced161b-4fe6-4c99-942c-06f01605ef89', 'serial': 'cced161b-4fe6-4c99-942c-06f01605ef89'}, 'mount_device': '/dev/vda', 'attachment_id': '810b8246-ad56-4876-9b96-e0796fa18995', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:03:20 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:03:20 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxmNSztl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:03:20 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:03:20 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:03:20 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9e4c10-97d6-4771-b7e9-37a77db44a70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:03:20 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ae7c9e-f5a8-49f1-a283-5144179a65fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89] added
Aug 09 23:03:20 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[62321e8f-cf8b-423b-80cf-133d0c5a3c04]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e479d10-a480-43b5-a72a-df5cb85ec7e0]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxmNSztl {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxmNSztl" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ae883-cb7b-485d-b4e3-3c06622c8171]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DxmNSztl'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f4b2d8-4b7b-4057-8bd3-089e9daaa8c3]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5d1d80-39af-4101-98ef-4350cb08c36a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:20 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:20 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:20 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:20 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:20 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:20 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:20 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:20 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:20 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:20 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7580cc2-4a56-4f48-861a-4215228ea3aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260]
Aug 09 23:03:20 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260] successful.
Aug 09 23:03:20 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[995b41ed-d4bf-4c23-b72b-6a89aa8a1a1e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e4462f-8939-4bbe-b6bf-b130830b3c04]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:21 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:21 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:21 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:21 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:21 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:21 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:21 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:21 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:21 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:21 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:21 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:21 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[77535106-c9b6-4f07-84f7-ec47596c3e6a]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxmNSztl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:03:21 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Deleted allocations for instance 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf
Aug 09 23:03:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:21 user nova-compute[72409]: DEBUG nova.objects.instance [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lazy-loading 'numa_topology' on Instance uuid 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23435333564613265', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435333564613265', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1886528577',display_name='tempest-ServerActionsTestOtherA-server-1886528577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1886528577',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzHC0syLklL8GtXvz6DwLHZAI3KijCzzG+c3H7vbfCfvBbdLu31zQrL5KQv6qO6LPapTOC2Zi0KeYbsTlIE+6d9oW1MPV8oBMrDCQEY9sL1aQ71vDiQHBGpACA1bJ0plQ==',key_name='tempest-keypair-183406528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7e3f592e7141659581ae7f67c6af43',ramdisk_id='',reservation_id='r-w5z89s1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-640999933',owner_user_name='tempest-ServerActionsTestOtherA-640999933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd76f1c0d9b42269fcc69f24c9f59e6',uuid=b0c67c33-9d1a-4479-a64f-8f867330b9dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converting VIF {"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.objects.instance [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'pci_devices' on Instance uuid b0c67c33-9d1a-4479-a64f-8f867330b9dc {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:03:22 user nova-compute[72409]:   <uuid>b0c67c33-9d1a-4479-a64f-8f867330b9dc</uuid>
Aug 09 23:03:22 user nova-compute[72409]:   <name>instance-00000020</name>
Aug 09 23:03:22 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:03:22 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:03:22 user nova-compute[72409]:   <metadata>
Aug 09 23:03:22 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:03:22 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:03:22 user nova-compute[72409]:       <nova:name>tempest-ServerActionsTestOtherA-server-1886528577</nova:name>
Aug 09 23:03:22 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:03:20</nova:creationTime>
Aug 09 23:03:22 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:03:22 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:03:22 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:03:22 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:03:22 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:03:22 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:03:22 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:03:22 user nova-compute[72409]:       <nova:owner>
Aug 09 23:03:22 user nova-compute[72409]:         <nova:user uuid="efd76f1c0d9b42269fcc69f24c9f59e6">tempest-ServerActionsTestOtherA-640999933-project-member</nova:user>
Aug 09 23:03:22 user nova-compute[72409]:         <nova:project uuid="8c7e3f592e7141659581ae7f67c6af43">tempest-ServerActionsTestOtherA-640999933</nova:project>
Aug 09 23:03:22 user nova-compute[72409]:       </nova:owner>
Aug 09 23:03:22 user nova-compute[72409]:       <nova:ports>
Aug 09 23:03:22 user nova-compute[72409]:         <nova:port uuid="b699c9c4-31f5-41b2-ac73-16353dceb256">
Aug 09 23:03:22 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 23:03:22 user nova-compute[72409]:         </nova:port>
Aug 09 23:03:22 user nova-compute[72409]:       </nova:ports>
Aug 09 23:03:22 user nova-compute[72409]:     </nova:instance>
Aug 09 23:03:22 user nova-compute[72409]:   </metadata>
Aug 09 23:03:22 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:03:22 user nova-compute[72409]:     <system>
Aug 09 23:03:22 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:03:22 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:03:22 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:03:22 user nova-compute[72409]:       <entry name="serial">b0c67c33-9d1a-4479-a64f-8f867330b9dc</entry>
Aug 09 23:03:22 user nova-compute[72409]:       <entry name="uuid">b0c67c33-9d1a-4479-a64f-8f867330b9dc</entry>
Aug 09 23:03:22 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:03:22 user nova-compute[72409]:     </system>
Aug 09 23:03:22 user nova-compute[72409]:   </sysinfo>
Aug 09 23:03:22 user nova-compute[72409]:   <os>
Aug 09 23:03:22 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:03:22 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:03:22 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:03:22 user nova-compute[72409]:   </os>
Aug 09 23:03:22 user nova-compute[72409]:   <features>
Aug 09 23:03:22 user nova-compute[72409]:     <acpi/>
Aug 09 23:03:22 user nova-compute[72409]:     <apic/>
Aug 09 23:03:22 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:03:22 user nova-compute[72409]:   </features>
Aug 09 23:03:22 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:03:22 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:03:22 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:03:22 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:03:22 user nova-compute[72409]:   </clock>
Aug 09 23:03:22 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:03:22 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:03:22 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:03:22 user nova-compute[72409]:   </cpu>
Aug 09 23:03:22 user nova-compute[72409]:   <devices>
Aug 09 23:03:22 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 23:03:22 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:03:22 user nova-compute[72409]:       <source dev="/dev/sdc"/>
Aug 09 23:03:22 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:03:22 user nova-compute[72409]:       <serial>cced161b-4fe6-4c99-942c-06f01605ef89</serial>
Aug 09 23:03:22 user nova-compute[72409]:     </disk>
Aug 09 23:03:22 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:03:22 user nova-compute[72409]:       <mac address="fa:16:3e:84:8e:ae"/>
Aug 09 23:03:22 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:03:22 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:03:22 user nova-compute[72409]:       <target dev="tapb699c9c4-31"/>
Aug 09 23:03:22 user nova-compute[72409]:     </interface>
Aug 09 23:03:22 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:03:22 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/b0c67c33-9d1a-4479-a64f-8f867330b9dc/console.log" append="off"/>
Aug 09 23:03:22 user nova-compute[72409]:     </serial>
Aug 09 23:03:22 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:03:22 user nova-compute[72409]:     <video>
Aug 09 23:03:22 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:03:22 user nova-compute[72409]:     </video>
Aug 09 23:03:22 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:03:22 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:03:22 user nova-compute[72409]:     </rng>
Aug 09 23:03:22 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:03:22 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:03:22 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:03:22 user nova-compute[72409]:     </memballoon>
Aug 09 23:03:22 user nova-compute[72409]:   </devices>
Aug 09 23:03:22 user nova-compute[72409]: </domain>
Aug 09 23:03:22 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1886528577',display_name='tempest-ServerActionsTestOtherA-server-1886528577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1886528577',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzHC0syLklL8GtXvz6DwLHZAI3KijCzzG+c3H7vbfCfvBbdLu31zQrL5KQv6qO6LPapTOC2Zi0KeYbsTlIE+6d9oW1MPV8oBMrDCQEY9sL1aQ71vDiQHBGpACA1bJ0plQ==',key_name='tempest-keypair-183406528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7e3f592e7141659581ae7f67c6af43',ramdisk_id='',reservation_id='r-w5z89s1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-640999933',owner_user_name='tempest-ServerActionsTestOtherA-640999933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd76f1c0d9b42269fcc69f24c9f59e6',uuid=b0c67c33-9d1a-4479-a64f-8f867330b9dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converting VIF {"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG os_vif [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb699c9c4-31, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb699c9c4-31, col_values=(('external_ids', {'iface-id': 'b699c9c4-31f5-41b2-ac73-16353dceb256', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:8e:ae', 'vm-uuid': 'b0c67c33-9d1a-4479-a64f-8f867330b9dc'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:22 user nova-compute[72409]: INFO os_vif [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31')
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] No VIF found with MAC fa:16:3e:84:8e:ae, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-58f2de47-ae07-486c-a01b-5047ff78f240 tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 9.664s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:22 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:03:22 user nova-compute[72409]: INFO nova.compute.claims [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Claim successful on node user
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.network.neutron [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:03:23 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.policy [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8411ad4a2fdd412783da8516d860cccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb0e0790757422da3f43722e4bd554e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:03:23 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Creating image(s)
Aug 09 23:03:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "/opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "/opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21.part --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-ea5e45c1-cf53-4e7d-9335-abee9bf82a64 req-3095991b-0577-4836-a4ca-c811756d0a61 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received event network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ea5e45c1-cf53-4e7d-9335-abee9bf82a64 req-3095991b-0577-4836-a4ca-c811756d0a61 service nova] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ea5e45c1-cf53-4e7d-9335-abee9bf82a64 req-3095991b-0577-4836-a4ca-c811756d0a61 service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ea5e45c1-cf53-4e7d-9335-abee9bf82a64 req-3095991b-0577-4836-a4ca-c811756d0a61 service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-ea5e45c1-cf53-4e7d-9335-abee9bf82a64 req-3095991b-0577-4836-a4ca-c811756d0a61 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] No waiting events found dispatching network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:23 user nova-compute[72409]: WARNING nova.compute.manager [req-ea5e45c1-cf53-4e7d-9335-abee9bf82a64 req-3095991b-0577-4836-a4ca-c811756d0a61 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received unexpected event network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 for instance with vm_state building and task_state spawning.
Aug 09 23:03:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21.part --force-share --output=json" returned: 0 in 0.141s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.virt.images [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] 5013c52b-967c-437e-9a94-0012dc27ed46 was qcow2, converting to raw {{(pid=72409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 23:03:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21.part /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21.converted {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:24 user nova-compute[72409]: DEBUG nova.network.neutron [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Successfully created port: 72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:03:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21.part /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21.converted" returned: 0 in 0.574s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21.converted --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.387s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21 --force-share --output=json" returned: 0 in 0.147s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21 --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21,backing_fmt=raw /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21,backing_fmt=raw /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk 1073741824" returned: 0 in 0.053s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21 --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.network.neutron [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Successfully updated port: 72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Cannot resize image /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'migration_context' on Instance uuid c0f72ca0-06ef-444d-97d4-fca49bdde831 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Ensure instance console log exists: /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquired lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.network.neutron [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.network.neutron [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-59627973-7763-4d2c-b0e1-5f95dc5e4cb6 req-4baf0047-ab91-4062-b0d2-fadb8f08c941 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-changed-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-59627973-7763-4d2c-b0e1-5f95dc5e4cb6 req-4baf0047-ab91-4062-b0d2-fadb8f08c941 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Refreshing instance network info cache due to event network-changed-72040fc9-f3df-43df-a3e4-c5ba8c410187. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-59627973-7763-4d2c-b0e1-5f95dc5e4cb6 req-4baf0047-ab91-4062-b0d2-fadb8f08c941 service nova] Acquiring lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622190.9144523, 5b7906a3-e02b-49a3-9a56-fc34a8730238 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:03:25 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] VM Stopped (Lifecycle Event)
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3b8f0e01-88e1-4816-84a3-30b4442aad59 None None] [instance: 5b7906a3-e02b-49a3-9a56-fc34a8730238] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-af423e4c-48ac-4833-b94f-4dd6f0f6c994 req-fe74ab7f-aecf-4a84-ae08-8dc74aca0348 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received event network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-af423e4c-48ac-4833-b94f-4dd6f0f6c994 req-fe74ab7f-aecf-4a84-ae08-8dc74aca0348 service nova] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-af423e4c-48ac-4833-b94f-4dd6f0f6c994 req-fe74ab7f-aecf-4a84-ae08-8dc74aca0348 service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-af423e4c-48ac-4833-b94f-4dd6f0f6c994 req-fe74ab7f-aecf-4a84-ae08-8dc74aca0348 service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-af423e4c-48ac-4833-b94f-4dd6f0f6c994 req-fe74ab7f-aecf-4a84-ae08-8dc74aca0348 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] No waiting events found dispatching network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:25 user nova-compute[72409]: WARNING nova.compute.manager [req-af423e4c-48ac-4833-b94f-4dd6f0f6c994 req-fe74ab7f-aecf-4a84-ae08-8dc74aca0348 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received unexpected event network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 for instance with vm_state building and task_state spawning.
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.network.neutron [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updating instance_info_cache with network_info: [{"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Releasing lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Instance network_info: |[{"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-59627973-7763-4d2c-b0e1-5f95dc5e4cb6 req-4baf0047-ab91-4062-b0d2-fadb8f08c941 service nova] Acquired lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.network.neutron [req-59627973-7763-4d2c-b0e1-5f95dc5e4cb6 req-4baf0047-ab91-4062-b0d2-fadb8f08c941 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Refreshing network info cache for port 72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Start _get_guest_xml network_info=[{"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T23:03:19Z,direct_url=<?>,disk_format='qcow2',id=5013c52b-967c-437e-9a94-0012dc27ed46,min_disk=0,min_ram=0,name='tempest-scenario-img--1348436401',owner='2fb0e0790757422da3f43722e4bd554e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T23:03:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '5013c52b-967c-437e-9a94-0012dc27ed46'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:03:26 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:03:26 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T23:03:19Z,direct_url=<?>,disk_format='qcow2',id=5013c52b-967c-437e-9a94-0012dc27ed46,min_disk=0,min_ram=0,name='tempest-scenario-img--1348436401',owner='2fb0e0790757422da3f43722e4bd554e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T23:03:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-186357607',display_name='tempest-TestMinimumBasicScenario-server-186357607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-186357607',id=33,image_ref='5013c52b-967c-437e-9a94-0012dc27ed46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFAR9IZB44DUyQYnxREnvvPQDdAJL8Rdwdh+Np3EcAGSsHf/h/KcsbHOE/uu430JCssRE9LJKDGK6dXZA0O4kVoiXAuAd/wWJMICmgROsbu9A3I5eSVsjj+WOvLe7aQww==',key_name='tempest-TestMinimumBasicScenario-1640560775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fb0e0790757422da3f43722e4bd554e',ramdisk_id='',reservation_id='r-wch0bk8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5013c52b-967c-437e-9a94-0012dc27ed46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1632899528',owner_user_name='tempest-TestMinimumBasicScenario-1632899528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:03:23Z,user_data=None,user_id='8411ad4a2fdd412783da8516d860cccb',uuid=c0f72ca0-06ef-444d-97d4-fca49bdde831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converting VIF {"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=72040fc9-f3df-43df-a3e4-c5ba8c410187,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72040fc9-f3') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'pci_devices' on Instance uuid c0f72ca0-06ef-444d-97d4-fca49bdde831 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:03:26 user nova-compute[72409]:   <uuid>c0f72ca0-06ef-444d-97d4-fca49bdde831</uuid>
Aug 09 23:03:26 user nova-compute[72409]:   <name>instance-00000021</name>
Aug 09 23:03:26 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:03:26 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:03:26 user nova-compute[72409]:   <metadata>
Aug 09 23:03:26 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:03:26 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:03:26 user nova-compute[72409]:       <nova:name>tempest-TestMinimumBasicScenario-server-186357607</nova:name>
Aug 09 23:03:26 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:03:26</nova:creationTime>
Aug 09 23:03:26 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:03:26 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:03:26 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:03:26 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:03:26 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:03:26 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:03:26 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:03:26 user nova-compute[72409]:       <nova:owner>
Aug 09 23:03:26 user nova-compute[72409]:         <nova:user uuid="8411ad4a2fdd412783da8516d860cccb">tempest-TestMinimumBasicScenario-1632899528-project-member</nova:user>
Aug 09 23:03:26 user nova-compute[72409]:         <nova:project uuid="2fb0e0790757422da3f43722e4bd554e">tempest-TestMinimumBasicScenario-1632899528</nova:project>
Aug 09 23:03:26 user nova-compute[72409]:       </nova:owner>
Aug 09 23:03:26 user nova-compute[72409]:       <nova:root type="image" uuid="5013c52b-967c-437e-9a94-0012dc27ed46"/>
Aug 09 23:03:26 user nova-compute[72409]:       <nova:ports>
Aug 09 23:03:26 user nova-compute[72409]:         <nova:port uuid="72040fc9-f3df-43df-a3e4-c5ba8c410187">
Aug 09 23:03:26 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 23:03:26 user nova-compute[72409]:         </nova:port>
Aug 09 23:03:26 user nova-compute[72409]:       </nova:ports>
Aug 09 23:03:26 user nova-compute[72409]:     </nova:instance>
Aug 09 23:03:26 user nova-compute[72409]:   </metadata>
Aug 09 23:03:26 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:03:26 user nova-compute[72409]:     <system>
Aug 09 23:03:26 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:03:26 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:03:26 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:03:26 user nova-compute[72409]:       <entry name="serial">c0f72ca0-06ef-444d-97d4-fca49bdde831</entry>
Aug 09 23:03:26 user nova-compute[72409]:       <entry name="uuid">c0f72ca0-06ef-444d-97d4-fca49bdde831</entry>
Aug 09 23:03:26 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:03:26 user nova-compute[72409]:     </system>
Aug 09 23:03:26 user nova-compute[72409]:   </sysinfo>
Aug 09 23:03:26 user nova-compute[72409]:   <os>
Aug 09 23:03:26 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:03:26 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:03:26 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:03:26 user nova-compute[72409]:   </os>
Aug 09 23:03:26 user nova-compute[72409]:   <features>
Aug 09 23:03:26 user nova-compute[72409]:     <acpi/>
Aug 09 23:03:26 user nova-compute[72409]:     <apic/>
Aug 09 23:03:26 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:03:26 user nova-compute[72409]:   </features>
Aug 09 23:03:26 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:03:26 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:03:26 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:03:26 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:03:26 user nova-compute[72409]:   </clock>
Aug 09 23:03:26 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:03:26 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:03:26 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:03:26 user nova-compute[72409]:   </cpu>
Aug 09 23:03:26 user nova-compute[72409]:   <devices>
Aug 09 23:03:26 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:03:26 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:03:26 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk"/>
Aug 09 23:03:26 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:03:26 user nova-compute[72409]:     </disk>
Aug 09 23:03:26 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:03:26 user nova-compute[72409]:       <mac address="fa:16:3e:03:7b:bf"/>
Aug 09 23:03:26 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:03:26 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:03:26 user nova-compute[72409]:       <target dev="tap72040fc9-f3"/>
Aug 09 23:03:26 user nova-compute[72409]:     </interface>
Aug 09 23:03:26 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:03:26 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/console.log" append="off"/>
Aug 09 23:03:26 user nova-compute[72409]:     </serial>
Aug 09 23:03:26 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:03:26 user nova-compute[72409]:     <video>
Aug 09 23:03:26 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:03:26 user nova-compute[72409]:     </video>
Aug 09 23:03:26 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:03:26 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:03:26 user nova-compute[72409]:     </rng>
Aug 09 23:03:26 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:03:26 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:03:26 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:03:26 user nova-compute[72409]:     </memballoon>
Aug 09 23:03:26 user nova-compute[72409]:   </devices>
Aug 09 23:03:26 user nova-compute[72409]: </domain>
Aug 09 23:03:26 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-186357607',display_name='tempest-TestMinimumBasicScenario-server-186357607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-186357607',id=33,image_ref='5013c52b-967c-437e-9a94-0012dc27ed46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFAR9IZB44DUyQYnxREnvvPQDdAJL8Rdwdh+Np3EcAGSsHf/h/KcsbHOE/uu430JCssRE9LJKDGK6dXZA0O4kVoiXAuAd/wWJMICmgROsbu9A3I5eSVsjj+WOvLe7aQww==',key_name='tempest-TestMinimumBasicScenario-1640560775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fb0e0790757422da3f43722e4bd554e',ramdisk_id='',reservation_id='r-wch0bk8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5013c52b-967c-437e-9a94-0012dc27ed46',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1632899528',owner_user_name='tempest-TestMinimumBasicScenario-1632899528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:03:23Z,user_data=None,user_id='8411ad4a2fdd412783da8516d860cccb',uuid=c0f72ca0-06ef-444d-97d4-fca49bdde831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converting VIF {"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=72040fc9-f3df-43df-a3e4-c5ba8c410187,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72040fc9-f3') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG os_vif [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=72040fc9-f3df-43df-a3e4-c5ba8c410187,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72040fc9-f3') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72040fc9-f3, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72040fc9-f3, col_values=(('external_ids', {'iface-id': '72040fc9-f3df-43df-a3e4-c5ba8c410187', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:7b:bf', 'vm-uuid': 'c0f72ca0-06ef-444d-97d4-fca49bdde831'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:26 user nova-compute[72409]: INFO os_vif [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=72040fc9-f3df-43df-a3e4-c5ba8c410187,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72040fc9-f3')
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622206.3497262, b0c67c33-9d1a-4479-a64f-8f867330b9dc => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:03:26 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] VM Resumed (Lifecycle Event)
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] No VIF found with MAC fa:16:3e:03:7b:bf, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:03:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Instance spawned successfully.
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:03:26 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622206.3511612, b0c67c33-9d1a-4479-a64f-8f867330b9dc => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:03:26 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] VM Started (Lifecycle Event)
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:03:26 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:03:26 user nova-compute[72409]: INFO nova.compute.manager [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:03:26 user nova-compute[72409]: INFO nova.compute.manager [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Took 18.62 seconds to build instance.
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.network.neutron [req-59627973-7763-4d2c-b0e1-5f95dc5e4cb6 req-4baf0047-ab91-4062-b0d2-fadb8f08c941 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updated VIF entry in instance network info cache for port 72040fc9-f3df-43df-a3e4-c5ba8c410187. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG nova.network.neutron [req-59627973-7763-4d2c-b0e1-5f95dc5e4cb6 req-4baf0047-ab91-4062-b0d2-fadb8f08c941 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updating instance_info_cache with network_info: [{"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-efe179be-759a-4b6e-83a3-00ba62630e8f tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.712s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-59627973-7763-4d2c-b0e1-5f95dc5e4cb6 req-4baf0047-ab91-4062-b0d2-fadb8f08c941 service nova] Releasing lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:03:27 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622192.6567903, 913c4e3b-f449-45fa-9ca7-3cef4b982679 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:03:27 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] VM Stopped (Lifecycle Event)
Aug 09 23:03:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-31a2e325-2ad1-4558-8b99-a37591f50697 None None] [instance: 913c4e3b-f449-45fa-9ca7-3cef4b982679] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:03:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-43239875-e2ec-401a-a41c-3683943e97b6 req-312f440d-b2e6-434f-9c05-12c3365b0343 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-43239875-e2ec-401a-a41c-3683943e97b6 req-312f440d-b2e6-434f-9c05-12c3365b0343 service nova] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-43239875-e2ec-401a-a41c-3683943e97b6 req-312f440d-b2e6-434f-9c05-12c3365b0343 service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-43239875-e2ec-401a-a41c-3683943e97b6 req-312f440d-b2e6-434f-9c05-12c3365b0343 service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-43239875-e2ec-401a-a41c-3683943e97b6 req-312f440d-b2e6-434f-9c05-12c3365b0343 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] No waiting events found dispatching network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:28 user nova-compute[72409]: WARNING nova.compute.manager [req-43239875-e2ec-401a-a41c-3683943e97b6 req-312f440d-b2e6-434f-9c05-12c3365b0343 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received unexpected event network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 for instance with vm_state building and task_state spawning.
Aug 09 23:03:28 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622193.45839, 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:03:28 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] VM Stopped (Lifecycle Event)
Aug 09 23:03:28 user nova-compute[72409]: DEBUG nova.compute.manager [None req-18c0cc84-982a-43c5-b5e0-0ed523485a92 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:03:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-b6c33a0e-70d7-44d0-a937-cc8aa85ee092 req-02baccb5-f46b-4bb5-8838-a2991d3a620b service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b6c33a0e-70d7-44d0-a937-cc8aa85ee092 req-02baccb5-f46b-4bb5-8838-a2991d3a620b service nova] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b6c33a0e-70d7-44d0-a937-cc8aa85ee092 req-02baccb5-f46b-4bb5-8838-a2991d3a620b service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b6c33a0e-70d7-44d0-a937-cc8aa85ee092 req-02baccb5-f46b-4bb5-8838-a2991d3a620b service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-b6c33a0e-70d7-44d0-a937-cc8aa85ee092 req-02baccb5-f46b-4bb5-8838-a2991d3a620b service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] No waiting events found dispatching network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:30 user nova-compute[72409]: WARNING nova.compute.manager [req-b6c33a0e-70d7-44d0-a937-cc8aa85ee092 req-02baccb5-f46b-4bb5-8838-a2991d3a620b service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received unexpected event network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 for instance with vm_state building and task_state spawning.
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622210.4238768, c0f72ca0-06ef-444d-97d4-fca49bdde831 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:03:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] VM Resumed (Lifecycle Event)
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:03:30 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Instance spawned successfully.
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:03:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622210.4243872, c0f72ca0-06ef-444d-97d4-fca49bdde831 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:03:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] VM Started (Lifecycle Event)
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:03:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:03:30 user nova-compute[72409]: INFO nova.compute.manager [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Took 7.24 seconds to spawn the instance on the hypervisor.
Aug 09 23:03:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:03:30 user nova-compute[72409]: INFO nova.compute.manager [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Took 8.06 seconds to build instance.
Aug 09 23:03:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9100b2de-392b-469f-a696-e2d50655b7b4 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.272s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzQTeZPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:03:33 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:03:33 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:03:33 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41cd768-d983-449f-b409-40f8e3b77176]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:03:33 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[367abc32-aa2f-4897-b537-38bb2976dab0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86] added
Aug 09 23:03:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.074s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bccd656-f15f-4a44-8680-e0b1e4c10413]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.104s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae10b71-962e-4ea3-83bf-3fd3f50b0454]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzQTeZPp {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzQTeZPp" returned: 0 in 0.045s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[167234a5-7c1e-4b3f-b4dc-d1009b681609]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BzQTeZPp'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.049s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[39133b7e-31d6-4f80-b891-1aa9b4437898]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0aad14-510b-495d-9b6c-69f55e05bb68]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb2a832-3ef4-49a6-a9ec-f98704f2fdea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86, portal: 172.16.0.220,3260]
Aug 09 23:03:33 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86, portal: 172.16.0.220,3260] successful.
Aug 09 23:03:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4025bb-22a3-46d4-988b-bdb93f111bd1]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df89771-4035-448a-bff7-9dd92201c78f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 (non-flash)
Aug 09 23:03:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.571s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] HCTL ('39', '-', '-', 0) found on session 38 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe699677-bf31-415c-8850-e67c29abd356]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Searching for a device in session 38 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:03:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzQTeZPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:03:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.614s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:03:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] <== connect_volume: return (1616ms) {'type': 'block', 'scsi_wwn': '26365316639383661', 'path': '/dev/sdh'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:03:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365316639383661', 'path': '/dev/sdh'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:03:34 user nova-compute[72409]: DEBUG nova.objects.instance [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lazy-loading 'flavor' on Instance uuid f6761b27-e1f3-4f6e-a7e7-990910a3523b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:03:34 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:03:34 user nova-compute[72409]:   <source dev="/dev/sdh"/>
Aug 09 23:03:34 user nova-compute[72409]:   <target dev="vdc" bus="virtio"/>
Aug 09 23:03:34 user nova-compute[72409]:   <serial>bc946993-b59b-462d-aa07-d2349d846c86</serial>
Aug 09 23:03:34 user nova-compute[72409]: </disk>
Aug 09 23:03:34 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:03:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:03:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:03:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:03:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] No VIF found with MAC fa:16:3e:ac:30:2c, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:03:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-861e3c39-d86a-4557-bd53-a452ffc56a9c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.282s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:36 user nova-compute[72409]: INFO nova.compute.manager [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Detaching volume bc946993-b59b-462d-aa07-d2349d846c86
Aug 09 23:03:36 user nova-compute[72409]: INFO nova.virt.block_device [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Attempting to driver detach volume bc946993-b59b-462d-aa07-d2349d846c86 from mountpoint /dev/vdc
Aug 09 23:03:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Attempting to detach device vdc from instance f6761b27-e1f3-4f6e-a7e7-990910a3523b from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:03:36 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:03:36 user nova-compute[72409]:   <source dev="/dev/sdh"/>
Aug 09 23:03:36 user nova-compute[72409]:   <target dev="vdc" bus="virtio"/>
Aug 09 23:03:36 user nova-compute[72409]:   <serial>bc946993-b59b-462d-aa07-d2349d846c86</serial>
Aug 09 23:03:36 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 23:03:36 user nova-compute[72409]: </disk>
Aug 09 23:03:36 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:03:36 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Successfully detached device vdc from instance f6761b27-e1f3-4f6e-a7e7-990910a3523b from the persistent domain config.
Aug 09 23:03:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f6761b27-e1f3-4f6e-a7e7-990910a3523b from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:03:36 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:03:36 user nova-compute[72409]:   <source dev="/dev/sdh"/>
Aug 09 23:03:36 user nova-compute[72409]:   <target dev="vdc" bus="virtio"/>
Aug 09 23:03:36 user nova-compute[72409]:   <serial>bc946993-b59b-462d-aa07-d2349d846c86</serial>
Aug 09 23:03:36 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 23:03:36 user nova-compute[72409]: </disk>
Aug 09 23:03:36 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622216.6932917, f6761b27-e1f3-4f6e-a7e7-990910a3523b => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f6761b27-e1f3-4f6e-a7e7-990910a3523b {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:03:36 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Successfully detached device vdc from instance f6761b27-e1f3-4f6e-a7e7-990910a3523b from the live domain config.
Aug 09 23:03:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzQTeZPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:03:36 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37d92fa-b259-438d-a08b-15ea6f154eb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[221e16bc-4adb-4ffb-a272-726710371389]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:36 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:36 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:36 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:36 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:36 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:36 user nova-compute[72409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 (non-flash)
Aug 09 23:03:36 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:36 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:36 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:36 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:36 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:36 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:36 user nova-compute[72409]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 (non-flash)
Aug 09 23:03:36 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84543ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86'): ({'sdh'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Removing single pathed devices sdh {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[32401bdf-76bf-49f0-b5b8-8bbdbe6a746b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9af01a-d97c-4830-b12a-7109a848c946]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Flushing IO for device /dev/sdh {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8f748b-474d-44de-bd21-0c371e5ac1e1]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[403ff575-bf57-453e-b27b-2b5ccb3bd67e]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] SCSI volumes sdh have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd83766f-f8ff-472a-98f0-9547b3ee986e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[453dc60f-690a-47a0-82f6-df0e9a04878d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86, portal: 172.16.0.220,3260]
Aug 09 23:03:37 user nova-compute[72409]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86, portal: 172.16.0.220,3260] successful.
Aug 09 23:03:37 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:37 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc946993-b59b-462d-aa07-d2349d846c86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:37 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[670e8aeb-bdfc-4197-9ff6-aa932fabd884]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:03:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] <== disconnect_volume: return (345ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:03:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:03:40 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lazy-loading 'flavor' on Instance uuid f6761b27-e1f3-4f6e-a7e7-990910a3523b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1f1b15ff-a3d9-4ab4-b63f-e5802575d11c tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.191s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "c17c9b77-8e04-432c-9634-c4bee2eb8889" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:41 user nova-compute[72409]: INFO nova.compute.manager [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Terminating instance
Aug 09 23:03:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-8495ead2-dd8b-49e6-9d1e-5b642dc220cc req-1c41f155-c24f-44ca-bc03-6fd948ad76b9 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Received event network-vif-unplugged-eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8495ead2-dd8b-49e6-9d1e-5b642dc220cc req-1c41f155-c24f-44ca-bc03-6fd948ad76b9 service nova] Acquiring lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8495ead2-dd8b-49e6-9d1e-5b642dc220cc req-1c41f155-c24f-44ca-bc03-6fd948ad76b9 service nova] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8495ead2-dd8b-49e6-9d1e-5b642dc220cc req-1c41f155-c24f-44ca-bc03-6fd948ad76b9 service nova] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-8495ead2-dd8b-49e6-9d1e-5b642dc220cc req-1c41f155-c24f-44ca-bc03-6fd948ad76b9 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] No waiting events found dispatching network-vif-unplugged-eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-8495ead2-dd8b-49e6-9d1e-5b642dc220cc req-1c41f155-c24f-44ca-bc03-6fd948ad76b9 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Received event network-vif-unplugged-eb543e82-6921-47dd-9645-c8b7d78aa15e for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:03:42 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Instance destroyed successfully.
Aug 09 23:03:42 user nova-compute[72409]: DEBUG nova.objects.instance [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lazy-loading 'resources' on Instance uuid c17c9b77-8e04-432c-9634-c4bee2eb8889 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:54:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2101604991',display_name='tempest-ServersNegativeTestJSON-server-2101604991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2101604991',id=17,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:54:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37caf02dd0db418cbbdcd1d13349bd53',ramdisk_id='',reservation_id='r-x91vjhsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-648629170',owner_user_name='tempest-ServersNegativeTestJSON-648629170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:54:52Z,user_data=None,user_id='28bd09bfc6304cb398964bbe964878bf',uuid=c17c9b77-8e04-432c-9634-c4bee2eb8889,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "address": "fa:16:3e:a6:51:84", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb543e82-69", "ovs_interfaceid": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:03:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Converting VIF {"id": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "address": "fa:16:3e:a6:51:84", "network": {"id": "f7b05dc9-1d2f-4bf0-ae58-5db03efc5687", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274551556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37caf02dd0db418cbbdcd1d13349bd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb543e82-69", "ovs_interfaceid": "eb543e82-6921-47dd-9645-c8b7d78aa15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:03:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:51:84,bridge_name='br-int',has_traffic_filtering=True,id=eb543e82-6921-47dd-9645-c8b7d78aa15e,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb543e82-69') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:03:42 user nova-compute[72409]: DEBUG os_vif [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:51:84,bridge_name='br-int',has_traffic_filtering=True,id=eb543e82-6921-47dd-9645-c8b7d78aa15e,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb543e82-69') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:03:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb543e82-69, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:03:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:03:42 user nova-compute[72409]: INFO os_vif [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:51:84,bridge_name='br-int',has_traffic_filtering=True,id=eb543e82-6921-47dd-9645-c8b7d78aa15e,network=Network(f7b05dc9-1d2f-4bf0-ae58-5db03efc5687),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb543e82-69')
Aug 09 23:03:42 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Deleting instance files /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889_del
Aug 09 23:03:42 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Deletion of /opt/stack/data/nova/instances/c17c9b77-8e04-432c-9634-c4bee2eb8889_del complete
Aug 09 23:03:42 user nova-compute[72409]: INFO nova.compute.manager [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 09 23:03:42 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:03:42 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:03:42 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:03:42 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:42 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Took 0.54 seconds to deallocate network for instance.
Aug 09 23:03:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:43 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:03:43 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:03:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:43 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Deleted allocations for instance c17c9b77-8e04-432c-9634-c4bee2eb8889
Aug 09 23:03:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3a98aba5-6d20-4d0f-9c79-dd32061877a5 tempest-ServersNegativeTestJSON-648629170 tempest-ServersNegativeTestJSON-648629170-project-member] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.039s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-13f7eb15-cb8e-4c5b-8d2e-0b30c745a228 req-76e619b5-3e5f-4dca-86f4-1a1e1e506b62 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Received event network-vif-plugged-eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-13f7eb15-cb8e-4c5b-8d2e-0b30c745a228 req-76e619b5-3e5f-4dca-86f4-1a1e1e506b62 service nova] Acquiring lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-13f7eb15-cb8e-4c5b-8d2e-0b30c745a228 req-76e619b5-3e5f-4dca-86f4-1a1e1e506b62 service nova] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-13f7eb15-cb8e-4c5b-8d2e-0b30c745a228 req-76e619b5-3e5f-4dca-86f4-1a1e1e506b62 service nova] Lock "c17c9b77-8e04-432c-9634-c4bee2eb8889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-13f7eb15-cb8e-4c5b-8d2e-0b30c745a228 req-76e619b5-3e5f-4dca-86f4-1a1e1e506b62 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] No waiting events found dispatching network-vif-plugged-eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:43 user nova-compute[72409]: WARNING nova.compute.manager [req-13f7eb15-cb8e-4c5b-8d2e-0b30c745a228 req-76e619b5-3e5f-4dca-86f4-1a1e1e506b62 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Received unexpected event network-vif-plugged-eb543e82-6921-47dd-9645-c8b7d78aa15e for instance with vm_state deleted and task_state None.
Aug 09 23:03:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-13f7eb15-cb8e-4c5b-8d2e-0b30c745a228 req-76e619b5-3e5f-4dca-86f4-1a1e1e506b62 service nova] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Received event network-vif-deleted-eb543e82-6921-47dd-9645-c8b7d78aa15e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "297f364c-8f40-410a-ad2e-c56d822a757e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "297f364c-8f40-410a-ad2e-c56d822a757e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:47 user nova-compute[72409]: INFO nova.compute.manager [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Detaching volume 4c1631fb-8092-4af5-a118-cb0689ab1517
Aug 09 23:03:47 user nova-compute[72409]: INFO nova.virt.block_device [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Attempting to driver detach volume 4c1631fb-8092-4af5-a118-cb0689ab1517 from mountpoint /dev/vdb
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "297f364c-8f40-410a-ad2e-c56d822a757e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Attempting to detach device vdb from instance 297f364c-8f40-410a-ad2e-c56d822a757e from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:03:47 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:03:47 user nova-compute[72409]:   <source dev="/dev/sdg"/>
Aug 09 23:03:47 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:03:47 user nova-compute[72409]:   <serial>4c1631fb-8092-4af5-a118-cb0689ab1517</serial>
Aug 09 23:03:47 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:03:47 user nova-compute[72409]: </disk>
Aug 09 23:03:47 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:03:47 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Successfully detached device vdb from instance 297f364c-8f40-410a-ad2e-c56d822a757e from the persistent domain config.
Aug 09 23:03:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 297f364c-8f40-410a-ad2e-c56d822a757e from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:03:47 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:03:47 user nova-compute[72409]:   <source dev="/dev/sdg"/>
Aug 09 23:03:47 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:03:47 user nova-compute[72409]:   <serial>4c1631fb-8092-4af5-a118-cb0689ab1517</serial>
Aug 09 23:03:47 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:03:47 user nova-compute[72409]: </disk>
Aug 09 23:03:47 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622227.811568, 297f364c-8f40-410a-ad2e-c56d822a757e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 297f364c-8f40-410a-ad2e-c56d822a757e {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:03:47 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Successfully detached device vdb from instance 297f364c-8f40-410a-ad2e-c56d822a757e from the live domain config.
Aug 09 23:03:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irKGLjSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:03:47 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:03:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f09413-177f-476e-ab68-6188c2d45bad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91661af-a3a1-455a-859c-cfd63dfc0b8b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:47 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:47 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:47 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:47 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:47 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:47 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:47 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:47 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:47 user nova-compute[72409]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 (non-flash)
Aug 09 23:03:47 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:47 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:47 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84460670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517'): ({'sdg'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Removing single pathed devices sdg {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e8be3c-9477-4899-af4b-5902f7633469]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb460c0f-2cfd-4574-ba09-280ae5de3fd1]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Flushing IO for device /dev/sdg {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db20328-8248-481d-93da-ed69af53c48d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:03:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[203e551f-9dd6-427a-a181-930efb93220d]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] SCSI volumes sdg have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a86ef4f-be7e-43af-9f60-559482b81fb3]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eff067-2561-4242-b37a-a430688e3d3a]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517, portal: 172.16.0.220,3260]
Aug 09 23:03:48 user nova-compute[72409]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517, portal: 172.16.0.220,3260] successful.
Aug 09 23:03:48 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54c429c-ac89-4ce2-a68d-a8c794470042]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] <== disconnect_volume: return (318ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:03:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.objects.instance [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lazy-loading 'flavor' on Instance uuid 297f364c-8f40-410a-ad2e-c56d822a757e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-360ac71d-d559-4218-874b-84e658cbbc87 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "297f364c-8f40-410a-ad2e-c56d822a757e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.790s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "297f364c-8f40-410a-ad2e-c56d822a757e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.708s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:49 user nova-compute[72409]: INFO nova.compute.manager [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Terminating instance
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-f577e2d8-918c-4024-ac52-51be1d4bf3e3 req-0bc53e3c-b659-4edc-8263-ddf336f7ab66 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Received event network-vif-unplugged-e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f577e2d8-918c-4024-ac52-51be1d4bf3e3 req-0bc53e3c-b659-4edc-8263-ddf336f7ab66 service nova] Acquiring lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f577e2d8-918c-4024-ac52-51be1d4bf3e3 req-0bc53e3c-b659-4edc-8263-ddf336f7ab66 service nova] Lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f577e2d8-918c-4024-ac52-51be1d4bf3e3 req-0bc53e3c-b659-4edc-8263-ddf336f7ab66 service nova] Lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-f577e2d8-918c-4024-ac52-51be1d4bf3e3 req-0bc53e3c-b659-4edc-8263-ddf336f7ab66 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] No waiting events found dispatching network-vif-unplugged-e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-f577e2d8-918c-4024-ac52-51be1d4bf3e3 req-0bc53e3c-b659-4edc-8263-ddf336f7ab66 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Received event network-vif-unplugged-e60933af-9d7b-4f1d-bfbc-c202db40a783 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:03:49 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Instance destroyed successfully.
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.objects.instance [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lazy-loading 'resources' on Instance uuid 297f364c-8f40-410a-ad2e-c56d822a757e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2081870308',display_name='tempest-VolumesSnapshotTestJSON-instance-2081870308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2081870308',id=28,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnqLAv3+6fqV1ApORltOPUdAJE3eln5jZMMiZH7YRZIpmvBpsDpJjzOougqbamh/XMQ8GIoHcCoI0ZsTa+QkwIaQDi06zHZ5FbVdU1VKUvGrFpNE3k8iBvfL09BuMpkFg==',key_name='tempest-keypair-661746355',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:00:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='302ec6e31abf4e89847c80adbb45be87',ramdisk_id='',reservation_id='r-xr81j5y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-725320644',owner_user_name='tempest-VolumesSnapshotTestJSON-725320644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539168ee5b36474680b3e9fc785a2237',uuid=297f364c-8f40-410a-ad2e-c56d822a757e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "address": "fa:16:3e:2a:f7:e9", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60933af-9d", "ovs_interfaceid": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Converting VIF {"id": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "address": "fa:16:3e:2a:f7:e9", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape60933af-9d", "ovs_interfaceid": "e60933af-9d7b-4f1d-bfbc-c202db40a783", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e60933af-9d7b-4f1d-bfbc-c202db40a783,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60933af-9d') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG os_vif [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e60933af-9d7b-4f1d-bfbc-c202db40a783,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60933af-9d') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape60933af-9d, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:03:49 user nova-compute[72409]: INFO os_vif [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f7:e9,bridge_name='br-int',has_traffic_filtering=True,id=e60933af-9d7b-4f1d-bfbc-c202db40a783,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape60933af-9d')
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irKGLjSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:03:49 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:03:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c1631fb-8092-4af5-a118-cb0689ab1517', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd505cc4-2dbd-4d74-a988-04955531e9ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d513d617-65bf-4550-9b8a-0fd812e7395f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:49 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:49 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:49 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:49 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:49 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:49 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:49 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:49 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:49 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:49 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e9c3ae3b0>, {}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Disconnecting from: [] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] <== disconnect_volume: return (50ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:03:49 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Deleting instance files /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e_del
Aug 09 23:03:49 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Deletion of /opt/stack/data/nova/instances/297f364c-8f40-410a-ad2e-c56d822a757e_del complete
Aug 09 23:03:49 user nova-compute[72409]: INFO nova.compute.manager [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 23:03:49 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:03:49 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:03:50 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:50 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Took 0.71 seconds to deallocate network for instance.
Aug 09 23:03:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-e386dc92-5996-43d1-91dc-dd920dd63fc5 req-90a8658c-cf0d-4262-ae89-6fb0c4dfc2f1 service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Received event network-vif-deleted-e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:50 user nova-compute[72409]: WARNING nova.volume.cinder [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Attachment 3df02d3b-ed7e-4acc-8da2-b800d85d1da5 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3df02d3b-ed7e-4acc-8da2-b800d85d1da5. (HTTP 404) (Request-ID: req-56581823-f4e7-470e-a522-f9fdca699311)
Aug 09 23:03:50 user nova-compute[72409]: INFO nova.compute.manager [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Took 0.03 seconds to detach 1 volumes for instance.
Aug 09 23:03:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:51 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:03:51 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:03:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:51 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Deleted allocations for instance 297f364c-8f40-410a-ad2e-c56d822a757e
Aug 09 23:03:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e5c02d2-27d4-4d70-97de-1c54efcf2c14 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "297f364c-8f40-410a-ad2e-c56d822a757e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.151s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-3c6bbbf5-7dd4-4e69-a4e9-6c0c83b65898 req-747951f8-263d-4d6e-8143-85a15a77147b service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Received event network-vif-plugged-e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3c6bbbf5-7dd4-4e69-a4e9-6c0c83b65898 req-747951f8-263d-4d6e-8143-85a15a77147b service nova] Acquiring lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3c6bbbf5-7dd4-4e69-a4e9-6c0c83b65898 req-747951f8-263d-4d6e-8143-85a15a77147b service nova] Lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3c6bbbf5-7dd4-4e69-a4e9-6c0c83b65898 req-747951f8-263d-4d6e-8143-85a15a77147b service nova] Lock "297f364c-8f40-410a-ad2e-c56d822a757e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-3c6bbbf5-7dd4-4e69-a4e9-6c0c83b65898 req-747951f8-263d-4d6e-8143-85a15a77147b service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] No waiting events found dispatching network-vif-plugged-e60933af-9d7b-4f1d-bfbc-c202db40a783 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:51 user nova-compute[72409]: WARNING nova.compute.manager [req-3c6bbbf5-7dd4-4e69-a4e9-6c0c83b65898 req-747951f8-263d-4d6e-8143-85a15a77147b service nova] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Received unexpected event network-vif-plugged-e60933af-9d7b-4f1d-bfbc-c202db40a783 for instance with vm_state deleted and task_state None.
Aug 09 23:03:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG nova.compute.manager [req-6a07275c-51bd-4cd6-ba32-1adf38dd7ea7 req-dd4a6c57-2abe-47b4-b210-0354545ee5fc service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Received event network-changed-8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG nova.compute.manager [req-6a07275c-51bd-4cd6-ba32-1adf38dd7ea7 req-dd4a6c57-2abe-47b4-b210-0354545ee5fc service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Refreshing instance network info cache due to event network-changed-8a5900fa-28ca-41a1-8e15-770437c81648. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a07275c-51bd-4cd6-ba32-1adf38dd7ea7 req-dd4a6c57-2abe-47b4-b210-0354545ee5fc service nova] Acquiring lock "refresh_cache-b752ae8f-b489-4a42-a395-8c204a4298bb" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a07275c-51bd-4cd6-ba32-1adf38dd7ea7 req-dd4a6c57-2abe-47b4-b210-0354545ee5fc service nova] Acquired lock "refresh_cache-b752ae8f-b489-4a42-a395-8c204a4298bb" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG nova.network.neutron [req-6a07275c-51bd-4cd6-ba32-1adf38dd7ea7 req-dd4a6c57-2abe-47b4-b210-0354545ee5fc service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Refreshing network info cache for port 8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG nova.network.neutron [req-6a07275c-51bd-4cd6-ba32-1adf38dd7ea7 req-dd4a6c57-2abe-47b4-b210-0354545ee5fc service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Updated VIF entry in instance network info cache for port 8a5900fa-28ca-41a1-8e15-770437c81648. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG nova.network.neutron [req-6a07275c-51bd-4cd6-ba32-1adf38dd7ea7 req-dd4a6c57-2abe-47b4-b210-0354545ee5fc service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Updating instance_info_cache with network_info: [{"id": "8a5900fa-28ca-41a1-8e15-770437c81648", "address": "fa:16:3e:c7:3d:83", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5900fa-28", "ovs_interfaceid": "8a5900fa-28ca-41a1-8e15-770437c81648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a07275c-51bd-4cd6-ba32-1adf38dd7ea7 req-dd4a6c57-2abe-47b4-b210-0354545ee5fc service nova] Releasing lock "refresh_cache-b752ae8f-b489-4a42-a395-8c204a4298bb" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "b752ae8f-b489-4a42-a395-8c204a4298bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:53 user nova-compute[72409]: INFO nova.compute.manager [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Terminating instance
Aug 09 23:03:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-2041cbf6-b206-447c-a987-c44189d733e7 req-1fd323af-e333-4077-9f78-4310f3b08fe6 service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Received event network-vif-unplugged-8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2041cbf6-b206-447c-a987-c44189d733e7 req-1fd323af-e333-4077-9f78-4310f3b08fe6 service nova] Acquiring lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2041cbf6-b206-447c-a987-c44189d733e7 req-1fd323af-e333-4077-9f78-4310f3b08fe6 service nova] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2041cbf6-b206-447c-a987-c44189d733e7 req-1fd323af-e333-4077-9f78-4310f3b08fe6 service nova] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-2041cbf6-b206-447c-a987-c44189d733e7 req-1fd323af-e333-4077-9f78-4310f3b08fe6 service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] No waiting events found dispatching network-vif-unplugged-8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-2041cbf6-b206-447c-a987-c44189d733e7 req-1fd323af-e333-4077-9f78-4310f3b08fe6 service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Received event network-vif-unplugged-8a5900fa-28ca-41a1-8e15-770437c81648 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:03:54 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Instance destroyed successfully.
Aug 09 23:03:54 user nova-compute[72409]: DEBUG nova.objects.instance [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lazy-loading 'resources' on Instance uuid b752ae8f-b489-4a42-a395-8c204a4298bb {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-998004417',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-998004417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-998004417',id=31,image_ref='27d615ae-3499-4897-845d-9f3c25b7a51b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrANBkY7wekR1fw0OhanIxilHXiTaBdmQFbk25lBbMzvn7q/+fILqfcQI2zcqfZ2mMj6e6zV+qPY1fCCX8qu6XnLXCLMb42jzG8N5P44lxYW1nL8Jr1KxSRz/4xGKrg/A==',key_name='tempest-keypair-798188816',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:02:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-npdo2ey2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-431608932',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=b752ae8f-b489-4a42-a395-8c204a4298bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a5900fa-28ca-41a1-8e15-770437c81648", "address": "fa:16:3e:c7:3d:83", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5900fa-28", "ovs_interfaceid": "8a5900fa-28ca-41a1-8e15-770437c81648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "8a5900fa-28ca-41a1-8e15-770437c81648", "address": "fa:16:3e:c7:3d:83", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5900fa-28", "ovs_interfaceid": "8a5900fa-28ca-41a1-8e15-770437c81648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3d:83,bridge_name='br-int',has_traffic_filtering=True,id=8a5900fa-28ca-41a1-8e15-770437c81648,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5900fa-28') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_vif [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3d:83,bridge_name='br-int',has_traffic_filtering=True,id=8a5900fa-28ca-41a1-8e15-770437c81648,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5900fa-28') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a5900fa-28, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:03:54 user nova-compute[72409]: INFO os_vif [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:3d:83,bridge_name='br-int',has_traffic_filtering=True,id=8a5900fa-28ca-41a1-8e15-770437c81648,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5900fa-28')
Aug 09 23:03:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEGVHQUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:03:54 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f6197d-8920-4119-843e-69f3db7f1568]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3434ba-a3ab-4788-826c-c9a7eb1c0027]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:54 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:54 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:54 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:54 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:54 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:03:54 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:03:54 user nova-compute[72409]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 (non-flash)
Aug 09 23:03:54 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:03:54 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:03:54 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e9c3c9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086'): ({'sde'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Removing single pathed devices sde {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e005e7-1025-4095-9d87-a5594fa6e309]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99692ef-6fff-40da-9561-bdcec398c56b]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flushing IO for device /dev/sde {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c173423-3a75-40a5-b040-6baef27e042c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[446343d6-a6de-4aac-9b90-26e2f91370ce]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9fce1ffc-505237eecd53108b', '/dev/disk/by-id/scsi-23530353233376565', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9fce1ffc') {{(pid=83250) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0882ce12-f4f5-4077-92fb-f0c81b81ceee]: (4, None) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfedcfb8-ac93-4060-9c45-6f95df2f2cfa]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[495a1fae-ac02-4ca1-9495-a4c263a0856c]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086, portal: 172.16.0.220,3260]
Aug 09 23:03:54 user nova-compute[72409]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086, portal: 172.16.0.220,3260] successful.
Aug 09 23:03:54 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f47eed88-1cea-46fb-b06e-c835a88ed086 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9372c0d0-8e41-4ab1-ad76-ebb535538048]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:03:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:03:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:03:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== disconnect_volume: return (346ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:03:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:03:55 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Deleting instance files /opt/stack/data/nova/instances/b752ae8f-b489-4a42-a395-8c204a4298bb_del
Aug 09 23:03:55 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Deletion of /opt/stack/data/nova/instances/b752ae8f-b489-4a42-a395-8c204a4298bb_del complete
Aug 09 23:03:55 user nova-compute[72409]: INFO nova.compute.manager [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 09 23:03:55 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:03:55 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:03:55 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:03:55 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:03:55 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:03:55 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Took 0.87 seconds to deallocate network for instance.
Aug 09 23:03:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-e4c2f788-a64a-4532-8389-c0d4e9e4a32f req-85273c3d-18a9-4e8e-8ca0-e783ed9afcff service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Received event network-vif-deleted-8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-e0413e8b-ad27-472d-aeb4-e38360534920 req-64f7d390-f968-4fd0-8601-7905d175fab6 service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Received event network-vif-plugged-8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:03:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e0413e8b-ad27-472d-aeb4-e38360534920 req-64f7d390-f968-4fd0-8601-7905d175fab6 service nova] Acquiring lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e0413e8b-ad27-472d-aeb4-e38360534920 req-64f7d390-f968-4fd0-8601-7905d175fab6 service nova] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e0413e8b-ad27-472d-aeb4-e38360534920 req-64f7d390-f968-4fd0-8601-7905d175fab6 service nova] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-e0413e8b-ad27-472d-aeb4-e38360534920 req-64f7d390-f968-4fd0-8601-7905d175fab6 service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] No waiting events found dispatching network-vif-plugged-8a5900fa-28ca-41a1-8e15-770437c81648 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:03:56 user nova-compute[72409]: WARNING nova.compute.manager [req-e0413e8b-ad27-472d-aeb4-e38360534920 req-64f7d390-f968-4fd0-8601-7905d175fab6 service nova] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Received unexpected event network-vif-plugged-8a5900fa-28ca-41a1-8e15-770437c81648 for instance with vm_state active and task_state deleting.
Aug 09 23:03:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:56 user nova-compute[72409]: INFO nova.compute.manager [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Took 0.82 seconds to detach 1 volumes for instance.
Aug 09 23:03:56 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Deleting volume: f47eed88-1cea-46fb-b06e-c835a88ed086 {{(pid=72409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 23:03:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:57 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622222.0624373, c17c9b77-8e04-432c-9634-c4bee2eb8889 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:03:57 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] VM Stopped (Lifecycle Event)
Aug 09 23:03:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f02d54a3-8c27-43ff-993f-5ba881649499 None None] [instance: c17c9b77-8e04-432c-9634-c4bee2eb8889] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:03:57 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:03:57 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:03:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:57 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Deleted allocations for instance b752ae8f-b489-4a42-a395-8c204a4298bb
Aug 09 23:03:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e98c5c0-62d3-4caf-8bed-f6fc856795e1 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "b752ae8f-b489-4a42-a395-8c204a4298bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.443s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:58 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:03:58 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:03:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:03:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:03:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:03:58 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:03:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "c513e397-28f7-4d93-8487-257becbef9d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:00 user nova-compute[72409]: INFO nova.compute.manager [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Terminating instance
Aug 09 23:04:00 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG nova.compute.manager [req-be382432-767b-4b1c-a411-dab071f1661b req-575334cf-2e6c-49c4-a0c3-1de3a6cb51f1 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-unplugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-be382432-767b-4b1c-a411-dab071f1661b req-575334cf-2e6c-49c4-a0c3-1de3a6cb51f1 service nova] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-be382432-767b-4b1c-a411-dab071f1661b req-575334cf-2e6c-49c4-a0c3-1de3a6cb51f1 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-be382432-767b-4b1c-a411-dab071f1661b req-575334cf-2e6c-49c4-a0c3-1de3a6cb51f1 service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG nova.compute.manager [req-be382432-767b-4b1c-a411-dab071f1661b req-575334cf-2e6c-49c4-a0c3-1de3a6cb51f1 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] No waiting events found dispatching network-vif-unplugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG nova.compute.manager [req-be382432-767b-4b1c-a411-dab071f1661b req-575334cf-2e6c-49c4-a0c3-1de3a6cb51f1 service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-unplugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:01 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:04:01 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7444MB free_disk=25.371707916259766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:01 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Instance destroyed successfully.
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.objects.instance [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lazy-loading 'resources' on Instance uuid c513e397-28f7-4d93-8487-257becbef9d3 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "935c4677-a511-4b0e-aef3-57bc036220ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "935c4677-a511-4b0e-aef3-57bc036220ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2097419676',display_name='tempest-ServerActionsTestOtherB-server-2097419676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2097419676',id=19,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDelHCC8nFCHRTmFXWR19BOOB/f+NPR90u8i8YXxlReJTIRJmpJsKKUPRbCWzHe6UX+HR9F8ZTKdA6A0YGmKOztUWCiwbCDEi2c3eCmLXAc66rx+Q4ob5pL4kfTx6LhQUg==',key_name='tempest-keypair-351454578',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:01:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a302bac664904169ad012943400598db',ramdisk_id='',reservation_id='r-pfgn9xa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-68548202',owner_user_name='tempest-ServerActionsTestOtherB-68548202-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d662607342934fb7babc31e155f5d915',uuid=c513e397-28f7-4d93-8487-257becbef9d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converting VIF {"id": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "address": "fa:16:3e:26:c6:8e", "network": {"id": "caa71ba8-46e4-428e-94b3-ff354efde9a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-372540247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a302bac664904169ad012943400598db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf787-02", "ovs_interfaceid": "6afaf787-02f9-400f-b7a9-b0aa4df58939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_vif [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:04:01 user nova-compute[72409]: INFO nova.compute.manager [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Terminating instance
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6afaf787-02, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:04:01 user nova-compute[72409]: INFO os_vif [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:c6:8e,bridge_name='br-int',has_traffic_filtering=True,id=6afaf787-02f9-400f-b7a9-b0aa4df58939,network=Network(caa71ba8-46e4-428e-94b3-ff354efde9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf787-02')
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqbIjKzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:04:01 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b25f01-b1aa-4c32-9981-5f40f572f7b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9f49f5-baf2-4d78-8f34-bc67c315862d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:04:01 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:04:01 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:04:01 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:04:01 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:04:01 user nova-compute[72409]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 (non-flash)
Aug 09 23:04:01 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:04:01 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:04:01 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e94349090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35'): ({'sdd'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Removing single pathed devices sdd {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f245ce9e-51be-4f44-8d83-7fb04d673205]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[45348041-c11d-448a-a43e-019a3bd21743]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Flushing IO for device /dev/sdd {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 935c4677-a511-4b0e-aef3-57bc036220ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c513e397-28f7-4d93-8487-257becbef9d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 66750137-9d3c-476b-b21b-10032ab3d55d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance f6761b27-e1f3-4f6e-a7e7-990910a3523b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance b0c67c33-9d1a-4479-a64f-8f867330b9dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c0f72ca0-06ef-444d-97d4-fca49bdde831 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f58bf8-bbcd-4e11-9640-f11aa55c21f2]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39c14b7-f5de-4670-bd56-b439ea40b658]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[186babc9-ef74-48e0-ba54-414237ab4bfe]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-ae2e9635-2814-41ad-b52e-630fb2df9229 req-7cfad534-8796-4e9f-b83a-c29f096cc181 service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Received event network-vif-unplugged-303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ae2e9635-2814-41ad-b52e-630fb2df9229 req-7cfad534-8796-4e9f-b83a-c29f096cc181 service nova] Acquiring lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ae2e9635-2814-41ad-b52e-630fb2df9229 req-7cfad534-8796-4e9f-b83a-c29f096cc181 service nova] Lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ae2e9635-2814-41ad-b52e-630fb2df9229 req-7cfad534-8796-4e9f-b83a-c29f096cc181 service nova] Lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-ae2e9635-2814-41ad-b52e-630fb2df9229 req-7cfad534-8796-4e9f-b83a-c29f096cc181 service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] No waiting events found dispatching network-vif-unplugged-303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-ae2e9635-2814-41ad-b52e-630fb2df9229 req-7cfad534-8796-4e9f-b83a-c29f096cc181 service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Received event network-vif-unplugged-303157c8-fff1-4396-870a-5178c00f9bbf for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec8d781-ecf0-457a-aa59-4f725de84893]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260]
Aug 09 23:04:01 user nova-compute[72409]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35, portal: 172.16.0.220,3260] successful.
Aug 09 23:04:01 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba73b6b3-f9c5-4f40-a63f-3bb2435b9e35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc58720a-c446-4d04-8f89-cd2c932f18b3]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] <== disconnect_volume: return (338ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:04:01 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Deleting instance files /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3_del
Aug 09 23:04:01 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Deletion of /opt/stack/data/nova/instances/c513e397-28f7-4d93-8487-257becbef9d3_del complete
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:04:01 user nova-compute[72409]: INFO nova.compute.manager [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Took 1.66 seconds to destroy the instance on the hypervisor.
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Instance destroyed successfully.
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lazy-loading 'resources' on Instance uuid 935c4677-a511-4b0e-aef3-57bc036220ab {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-935040839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-935040839',id=1,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7dfbbb5a1d134adba458e9c592f6fada',ramdisk_id='',reservation_id='r-8u6e2v3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-426575742',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:51:50Z,user_data=None,user_id='8bf771a74e994703bd1ed49add72cd14',uuid=935c4677-a511-4b0e-aef3-57bc036220ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converting VIF {"id": "303157c8-fff1-4396-870a-5178c00f9bbf", "address": "fa:16:3e:cd:b1:a5", "network": {"id": "f71ec857-9909-42ed-9dbb-487782552607", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-688853607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dfbbb5a1d134adba458e9c592f6fada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap303157c8-ff", "ovs_interfaceid": "303157c8-fff1-4396-870a-5178c00f9bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:b1:a5,bridge_name='br-int',has_traffic_filtering=True,id=303157c8-fff1-4396-870a-5178c00f9bbf,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap303157c8-ff') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG os_vif [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:b1:a5,bridge_name='br-int',has_traffic_filtering=True,id=303157c8-fff1-4396-870a-5178c00f9bbf,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap303157c8-ff') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap303157c8-ff, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:04:02 user nova-compute[72409]: INFO os_vif [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:b1:a5,bridge_name='br-int',has_traffic_filtering=True,id=303157c8-fff1-4396-870a-5178c00f9bbf,network=Network(f71ec857-9909-42ed-9dbb-487782552607),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap303157c8-ff')
Aug 09 23:04:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Deleting instance files /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab_del
Aug 09 23:04:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Deletion of /opt/stack/data/nova/instances/935c4677-a511-4b0e-aef3-57bc036220ab_del complete
Aug 09 23:04:02 user nova-compute[72409]: INFO nova.compute.manager [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 23:04:02 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-d29d5bf2-b6db-44f7-8a82-444cc2c920e5 req-38ebe60b-3f0e-436c-af15-33a79e40dcfb service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d29d5bf2-b6db-44f7-8a82-444cc2c920e5 req-38ebe60b-3f0e-436c-af15-33a79e40dcfb service nova] Acquiring lock "c513e397-28f7-4d93-8487-257becbef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d29d5bf2-b6db-44f7-8a82-444cc2c920e5 req-38ebe60b-3f0e-436c-af15-33a79e40dcfb service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d29d5bf2-b6db-44f7-8a82-444cc2c920e5 req-38ebe60b-3f0e-436c-af15-33a79e40dcfb service nova] Lock "c513e397-28f7-4d93-8487-257becbef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-d29d5bf2-b6db-44f7-8a82-444cc2c920e5 req-38ebe60b-3f0e-436c-af15-33a79e40dcfb service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] No waiting events found dispatching network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:04:02 user nova-compute[72409]: WARNING nova.compute.manager [req-d29d5bf2-b6db-44f7-8a82-444cc2c920e5 req-38ebe60b-3f0e-436c-af15-33a79e40dcfb service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received unexpected event network-vif-plugged-6afaf787-02f9-400f-b7a9-b0aa4df58939 for instance with vm_state active and task_state deleting.
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:04:02 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Took 0.56 seconds to deallocate network for instance.
Aug 09 23:04:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Skipping network cache update for instance because it is being deleted. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 09 23:04:02 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Took 1.16 seconds to deallocate network for instance.
Aug 09 23:04:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:03 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Deleted allocations for instance 935c4677-a511-4b0e-aef3-57bc036220ab
Aug 09 23:04:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9836cae2-95eb-42a6-be45-c506a145dd19 tempest-ServerBootFromVolumeStableRescueTest-426575742 tempest-ServerBootFromVolumeStableRescueTest-426575742-project-member] Lock "935c4677-a511-4b0e-aef3-57bc036220ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.096s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-ee96a097-4647-4454-a968-2a4164779909 req-cdacd1d5-8179-48c1-96f7-cdeffd1a80fc service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Received event network-vif-plugged-303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ee96a097-4647-4454-a968-2a4164779909 req-cdacd1d5-8179-48c1-96f7-cdeffd1a80fc service nova] Acquiring lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ee96a097-4647-4454-a968-2a4164779909 req-cdacd1d5-8179-48c1-96f7-cdeffd1a80fc service nova] Lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ee96a097-4647-4454-a968-2a4164779909 req-cdacd1d5-8179-48c1-96f7-cdeffd1a80fc service nova] Lock "935c4677-a511-4b0e-aef3-57bc036220ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-ee96a097-4647-4454-a968-2a4164779909 req-cdacd1d5-8179-48c1-96f7-cdeffd1a80fc service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] No waiting events found dispatching network-vif-plugged-303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:04:03 user nova-compute[72409]: WARNING nova.compute.manager [req-ee96a097-4647-4454-a968-2a4164779909 req-cdacd1d5-8179-48c1-96f7-cdeffd1a80fc service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Received unexpected event network-vif-plugged-303157c8-fff1-4396-870a-5178c00f9bbf for instance with vm_state deleted and task_state None.
Aug 09 23:04:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-ee96a097-4647-4454-a968-2a4164779909 req-cdacd1d5-8179-48c1-96f7-cdeffd1a80fc service nova] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Received event network-vif-deleted-303157c8-fff1-4396-870a-5178c00f9bbf {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:04:03 user nova-compute[72409]: INFO nova.compute.manager [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Took 0.80 seconds to detach 1 volumes for instance.
Aug 09 23:04:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:04:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:04 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Deleted allocations for instance c513e397-28f7-4d93-8487-257becbef9d3
Aug 09 23:04:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad4f7c58-092f-4ba0-980c-1786893c9417 tempest-ServerActionsTestOtherB-68548202 tempest-ServerActionsTestOtherB-68548202-project-member] Lock "c513e397-28f7-4d93-8487-257becbef9d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.038s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-d63a90bb-7145-4d9e-b89c-a701575b7129 req-2e58a586-4063-4d58-b839-06115704405e service nova] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Received event network-vif-deleted-6afaf787-02f9-400f-b7a9-b0aa4df58939 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:04:04 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622229.7989984, 297f364c-8f40-410a-ad2e-c56d822a757e => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:04:04 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] VM Stopped (Lifecycle Event)
Aug 09 23:04:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f324857e-9e9a-4912-b9ff-c55f621c3bca None None] [instance: 297f364c-8f40-410a-ad2e-c56d822a757e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:04:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:09 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622234.6488247, b752ae8f-b489-4a42-a395-8c204a4298bb => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:04:09 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] VM Stopped (Lifecycle Event)
Aug 09 23:04:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-da481398-c764-4edc-aa92-f5f6e03bac06 None None] [instance: b752ae8f-b489-4a42-a395-8c204a4298bb] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:04:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:04:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:04:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:04:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:04:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:16 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622241.0087614, c513e397-28f7-4d93-8487-257becbef9d3 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:04:16 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: c513e397-28f7-4d93-8487-257becbef9d3] VM Stopped (Lifecycle Event)
Aug 09 23:04:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c2524ac9-ec0b-4ee6-9173-118f7e388120 None None] [instance: c513e397-28f7-4d93-8487-257becbef9d3] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:04:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:17 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622242.066478, 935c4677-a511-4b0e-aef3-57bc036220ab => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:04:17 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] VM Stopped (Lifecycle Event)
Aug 09 23:04:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-85e6bac8-e77b-4881-b6e1-8e00c3e7a403 None None] [instance: 935c4677-a511-4b0e-aef3-57bc036220ab] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:04:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:26 user nova-compute[72409]: INFO nova.compute.manager [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Detaching volume 7271554e-2bd9-4b8e-831c-c59be7989002
Aug 09 23:04:26 user nova-compute[72409]: INFO nova.virt.block_device [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Attempting to driver detach volume 7271554e-2bd9-4b8e-831c-c59be7989002 from mountpoint /dev/vdb
Aug 09 23:04:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Attempting to detach device vdb from instance f6761b27-e1f3-4f6e-a7e7-990910a3523b from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:04:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:04:26 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:04:26 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:04:26 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:04:26 user nova-compute[72409]:   <serial>7271554e-2bd9-4b8e-831c-c59be7989002</serial>
Aug 09 23:04:26 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:04:26 user nova-compute[72409]: </disk>
Aug 09 23:04:26 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:04:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Successfully detached device vdb from instance f6761b27-e1f3-4f6e-a7e7-990910a3523b from the persistent domain config.
Aug 09 23:04:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6761b27-e1f3-4f6e-a7e7-990910a3523b from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:04:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:04:26 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:04:26 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:04:26 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:04:26 user nova-compute[72409]:   <serial>7271554e-2bd9-4b8e-831c-c59be7989002</serial>
Aug 09 23:04:26 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:04:26 user nova-compute[72409]: </disk>
Aug 09 23:04:26 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622267.1177576, f6761b27-e1f3-4f6e-a7e7-990910a3523b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6761b27-e1f3-4f6e-a7e7-990910a3523b {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:04:27 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Successfully detached device vdb from instance f6761b27-e1f3-4f6e-a7e7-990910a3523b from the live domain config.
Aug 09 23:04:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXdErbWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:04:27 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab81a48-5378-4c36-b60b-285cd5e97a30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8b0c78-ab18-415b-b4e7-d05a3556b8db]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:04:27 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:04:27 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:04:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:04:27 user nova-compute[72409]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 (non-flash)
Aug 09 23:04:27 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:04:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e942a45e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74fd5c5-ff05-42ba-b960-a1b4aced8cd6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58b7ebb-3ccc-4095-8261-0d9719eb7a30]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8168c1d3-5e85-4ed1-a1c0-a08e2e2c5832]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a84599-fd50-44b1-a97d-b8f8fb726ded]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[512c1d99-cbd1-4a61-b593-6ae449c4a2c0]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee0fc85-963f-4a0a-a979-56d3ef1bfa98]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002, portal: 172.16.0.220,3260]
Aug 09 23:04:27 user nova-compute[72409]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002, portal: 172.16.0.220,3260] successful.
Aug 09 23:04:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7271554e-2bd9-4b8e-831c-c59be7989002 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba04ecc-3e0c-4fe6-b86e-1fd8ea33681d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] <== disconnect_volume: return (275ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:04:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:04:28 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lazy-loading 'flavor' on Instance uuid f6761b27-e1f3-4f6e-a7e7-990910a3523b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:04:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9db554a6-cca4-4c69-863f-cc37f594f196 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.672s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:04:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:04:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:04:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:04:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:04:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:04:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:04:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "66750137-9d3c-476b-b21b-10032ab3d55d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "66750137-9d3c-476b-b21b-10032ab3d55d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:49 user nova-compute[72409]: INFO nova.compute.manager [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Terminating instance
Aug 09 23:04:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:04:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-f001f8ff-6b1d-4e33-ba0d-b6172628058f req-93471b4e-e7ca-4128-bfe3-b502a1337e31 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Received event network-vif-unplugged-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f001f8ff-6b1d-4e33-ba0d-b6172628058f req-93471b4e-e7ca-4128-bfe3-b502a1337e31 service nova] Acquiring lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f001f8ff-6b1d-4e33-ba0d-b6172628058f req-93471b4e-e7ca-4128-bfe3-b502a1337e31 service nova] Lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f001f8ff-6b1d-4e33-ba0d-b6172628058f req-93471b4e-e7ca-4128-bfe3-b502a1337e31 service nova] Lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-f001f8ff-6b1d-4e33-ba0d-b6172628058f req-93471b4e-e7ca-4128-bfe3-b502a1337e31 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] No waiting events found dispatching network-vif-unplugged-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-f001f8ff-6b1d-4e33-ba0d-b6172628058f req-93471b4e-e7ca-4128-bfe3-b502a1337e31 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Received event network-vif-unplugged-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:04:50 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Instance destroyed successfully.
Aug 09 23:04:50 user nova-compute[72409]: DEBUG nova.objects.instance [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lazy-loading 'resources' on Instance uuid 66750137-9d3c-476b-b21b-10032ab3d55d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T22:59:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1341110089',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1341110089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1341110089',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK/hff2gw3r3ebPo5709PN+l9TEdCS3/+SPkoxsUa894NCFc/m4rcEOkzrjyZV5Y8ODUSMuMu76pNcC1+pmGKqfQ7naTeXsdRo0xdN5+IYrRrCmd/CQQJq9cHTVI8ecTg==',key_name='tempest-keypair-1532149728',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-trc7six2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:00:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=66750137-9d3c-476b-b21b-10032ab3d55d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "address": "fa:16:3e:a3:31:62", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad0ad00-60", "ovs_interfaceid": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "address": "fa:16:3e:a3:31:62", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ad0ad00-60", "ovs_interfaceid": "1ad0ad00-6090-4417-80ed-1a3fb46e6c83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:31:62,bridge_name='br-int',has_traffic_filtering=True,id=1ad0ad00-6090-4417-80ed-1a3fb46e6c83,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad0ad00-60') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_vif [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:31:62,bridge_name='br-int',has_traffic_filtering=True,id=1ad0ad00-6090-4417-80ed-1a3fb46e6c83,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad0ad00-60') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ad0ad00-60, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:04:50 user nova-compute[72409]: INFO os_vif [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:31:62,bridge_name='br-int',has_traffic_filtering=True,id=1ad0ad00-6090-4417-80ed-1a3fb46e6c83,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ad0ad00-60')
Aug 09 23:04:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXZELpxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:04:50 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e449c8-e3f8-4ce3-aceb-f78f21892810]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daddc10-b669-4ca3-bafd-88c78aa0174b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:04:50 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:04:50 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be (non-flash)
Aug 09 23:04:50 user nova-compute[72409]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:04:50 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e845c9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be'): ({'sdf'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Removing single pathed devices sdf {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b35633c-7dcc-473a-8ffd-8a5a7f4eb0c7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6704ef62-80e1-44f6-8ebc-7cc81a059ce5]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flushing IO for device /dev/sdf {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc2424e-4ba7-4925-b788-0714ea64c33d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e4047a-af63-4689-a63f-99065b407653]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] SCSI volumes sdf have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_98ac9f7f',) {{(pid=83250) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc04305d-2692-4281-8603-6ebdd39c0bee]: (4, None) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aba59d-20e1-4ad4-baad-6b3e9a4a4286]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a68523-4a02-4acd-8b2d-90251706b8d7]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be, portal: 172.16.0.220,3260]
Aug 09 23:04:50 user nova-compute[72409]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be, portal: 172.16.0.220,3260] successful.
Aug 09 23:04:50 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:04:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:04:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0dff38-7586-497d-84f5-6de5d3a113be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:04:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b131c03-028f-4028-86fe-154b3216e971]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:04:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:04:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:04:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== disconnect_volume: return (314ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:04:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:04:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Deleting instance files /opt/stack/data/nova/instances/66750137-9d3c-476b-b21b-10032ab3d55d_del
Aug 09 23:04:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Deletion of /opt/stack/data/nova/instances/66750137-9d3c-476b-b21b-10032ab3d55d_del complete
Aug 09 23:04:51 user nova-compute[72409]: INFO nova.compute.manager [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 09 23:04:51 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:04:51 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:04:51 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:04:52 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:04:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-5d119982-3c13-4778-ae51-6f12802a8775 req-4148c474-06a0-442c-aa96-b882a027a4a1 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Received event network-vif-deleted-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:04:52 user nova-compute[72409]: INFO nova.compute.manager [req-5d119982-3c13-4778-ae51-6f12802a8775 req-4148c474-06a0-442c-aa96-b882a027a4a1 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Neutron deleted interface 1ad0ad00-6090-4417-80ed-1a3fb46e6c83; detaching it from the instance and deleting it from the info cache
Aug 09 23:04:52 user nova-compute[72409]: DEBUG nova.network.neutron [req-5d119982-3c13-4778-ae51-6f12802a8775 req-4148c474-06a0-442c-aa96-b882a027a4a1 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:04:52 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Took 1.00 seconds to deallocate network for instance.
Aug 09 23:04:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-5d119982-3c13-4778-ae51-6f12802a8775 req-4148c474-06a0-442c-aa96-b882a027a4a1 service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Detach interface failed, port_id=1ad0ad00-6090-4417-80ed-1a3fb46e6c83, reason: Instance 66750137-9d3c-476b-b21b-10032ab3d55d could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 23:04:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-c0b7668d-d7a4-476a-af26-9e02b3ffd7ac req-f3875db3-1e27-4081-b016-b35505fbebbb service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Received event network-vif-plugged-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:04:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c0b7668d-d7a4-476a-af26-9e02b3ffd7ac req-f3875db3-1e27-4081-b016-b35505fbebbb service nova] Acquiring lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c0b7668d-d7a4-476a-af26-9e02b3ffd7ac req-f3875db3-1e27-4081-b016-b35505fbebbb service nova] Lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c0b7668d-d7a4-476a-af26-9e02b3ffd7ac req-f3875db3-1e27-4081-b016-b35505fbebbb service nova] Lock "66750137-9d3c-476b-b21b-10032ab3d55d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-c0b7668d-d7a4-476a-af26-9e02b3ffd7ac req-f3875db3-1e27-4081-b016-b35505fbebbb service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] No waiting events found dispatching network-vif-plugged-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:04:52 user nova-compute[72409]: WARNING nova.compute.manager [req-c0b7668d-d7a4-476a-af26-9e02b3ffd7ac req-f3875db3-1e27-4081-b016-b35505fbebbb service nova] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Received unexpected event network-vif-plugged-1ad0ad00-6090-4417-80ed-1a3fb46e6c83 for instance with vm_state active and task_state deleting.
Aug 09 23:04:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:54 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:04:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:04:55 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:04:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-85cd66ee-5bc6-4839-ae9a-d24e0e4078e9 req-3475c160-15c0-4c22-aac9-ab8bc19ea26e service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-changed-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:04:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-85cd66ee-5bc6-4839-ae9a-d24e0e4078e9 req-3475c160-15c0-4c22-aac9-ab8bc19ea26e service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Refreshing instance network info cache due to event network-changed-410a93bc-9f2d-473e-acfb-bf171c4bcf4a. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:04:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-85cd66ee-5bc6-4839-ae9a-d24e0e4078e9 req-3475c160-15c0-4c22-aac9-ab8bc19ea26e service nova] Acquiring lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:04:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-85cd66ee-5bc6-4839-ae9a-d24e0e4078e9 req-3475c160-15c0-4c22-aac9-ab8bc19ea26e service nova] Acquired lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:04:59 user nova-compute[72409]: DEBUG nova.network.neutron [req-85cd66ee-5bc6-4839-ae9a-d24e0e4078e9 req-3475c160-15c0-4c22-aac9-ab8bc19ea26e service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Refreshing network info cache for port 410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:04:59 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:04:59 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:04:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:04:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:04:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:04:59 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG nova.network.neutron [req-85cd66ee-5bc6-4839-ae9a-d24e0e4078e9 req-3475c160-15c0-4c22-aac9-ab8bc19ea26e service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updated VIF entry in instance network info cache for port 410a93bc-9f2d-473e-acfb-bf171c4bcf4a. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG nova.network.neutron [req-85cd66ee-5bc6-4839-ae9a-d24e0e4078e9 req-3475c160-15c0-4c22-aac9-ab8bc19ea26e service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updating instance_info_cache with network_info: [{"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-85cd66ee-5bc6-4839-ae9a-d24e0e4078e9 req-3475c160-15c0-4c22-aac9-ab8bc19ea26e service nova] Releasing lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:00 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:01 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:01 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8000MB free_disk=25.463211059570312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:01 user nova-compute[72409]: INFO nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updating resource usage from migration a255be55-f015-48b8-a5b2-4189b8075782
Aug 09 23:05:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-9d8b597c-6a70-449d-bdb2-0bd5dba9837e req-ba47f7fd-4992-4e15-891c-0fbc779c648d service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received event network-changed-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-9d8b597c-6a70-449d-bdb2-0bd5dba9837e req-ba47f7fd-4992-4e15-891c-0fbc779c648d service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Refreshing instance network info cache due to event network-changed-b699c9c4-31f5-41b2-ac73-16353dceb256. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9d8b597c-6a70-449d-bdb2-0bd5dba9837e req-ba47f7fd-4992-4e15-891c-0fbc779c648d service nova] Acquiring lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9d8b597c-6a70-449d-bdb2-0bd5dba9837e req-ba47f7fd-4992-4e15-891c-0fbc779c648d service nova] Acquired lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG nova.network.neutron [req-9d8b597c-6a70-449d-bdb2-0bd5dba9837e req-ba47f7fd-4992-4e15-891c-0fbc779c648d service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Refreshing network info cache for port b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 66750137-9d3c-476b-b21b-10032ab3d55d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance f6761b27-e1f3-4f6e-a7e7-990910a3523b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c0f72ca0-06ef-444d-97d4-fca49bdde831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Migration a255be55-f015-48b8-a5b2-4189b8075782 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:05:01 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Stashing vm_state: active {{(pid=72409) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.objects.instance [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'pci_requests' on Instance uuid b0c67c33-9d1a-4479-a64f-8f867330b9dc {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:05:02 user nova-compute[72409]: INFO nova.compute.claims [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Claim successful on node user
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.objects.instance [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'resources' on Instance uuid b0c67c33-9d1a-4479-a64f-8f867330b9dc {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.objects.instance [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'pci_devices' on Instance uuid b0c67c33-9d1a-4479-a64f-8f867330b9dc {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:02 user nova-compute[72409]: INFO nova.compute.resource_tracker [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updating resource usage from migration a255be55-f015-48b8-a5b2-4189b8075782
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.network.neutron [req-9d8b597c-6a70-449d-bdb2-0bd5dba9837e req-ba47f7fd-4992-4e15-891c-0fbc779c648d service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updated VIF entry in instance network info cache for port b699c9c4-31f5-41b2-ac73-16353dceb256. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.network.neutron [req-9d8b597c-6a70-449d-bdb2-0bd5dba9837e req-ba47f7fd-4992-4e15-891c-0fbc779c648d service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updating instance_info_cache with network_info: [{"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9d8b597c-6a70-449d-bdb2-0bd5dba9837e req-ba47f7fd-4992-4e15-891c-0fbc779c648d service nova] Releasing lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.341s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:02 user nova-compute[72409]: INFO nova.compute.manager [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Migrating
Aug 09 23:05:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquired lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.network.neutron [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:05:02 user nova-compute[72409]: INFO nova.compute.manager [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Took 10.48 seconds to detach 1 volumes for instance.
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Deleting volume: bc0dff38-7586-497d-84f5-6de5d3a113be {{(pid=72409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:05:02 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:05:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:03 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Deleted allocations for instance 66750137-9d3c-476b-b21b-10032ab3d55d
Aug 09 23:05:03 user nova-compute[72409]: DEBUG nova.network.neutron [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updating instance_info_cache with network_info: [{"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7c8f9c4e-7b1e-46fc-8106-be5025127f04 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "66750137-9d3c-476b-b21b-10032ab3d55d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.288s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Releasing lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Starting migrate_disk_and_power_off {{(pid=72409) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 23:05:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:04 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Instance destroyed successfully.
Aug 09 23:05:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1886528577',display_name='tempest-ServerActionsTestOtherA-server-1886528577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1886528577',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzHC0syLklL8GtXvz6DwLHZAI3KijCzzG+c3H7vbfCfvBbdLu31zQrL5KQv6qO6LPapTOC2Zi0KeYbsTlIE+6d9oW1MPV8oBMrDCQEY9sL1aQ71vDiQHBGpACA1bJ0plQ==',key_name='tempest-keypair-183406528',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c7e3f592e7141659581ae7f67c6af43',ramdisk_id='',reservation_id='r-w5z89s1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-640999933',owner_user_name='tempest-ServerActionsTestOtherA-640999933-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:05:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd76f1c0d9b42269fcc69f24c9f59e6',uuid=b0c67c33-9d1a-4479-a64f-8f867330b9dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2069897593-network", "vif_mac": "fa:16:3e:84:8e:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converting VIF {"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2069897593-network", "vif_mac": "fa:16:3e:84:8e:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_vif [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb699c9c4-31, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:05:04 user nova-compute[72409]: INFO os_vif [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31')
Aug 09 23:05:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxmNSztl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:05:04 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[923254f7-6e52-42e2-8c21-e8347b1b4c3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a80381-8d0a-442d-8be6-de81efd8a1e6]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:05:04 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:05:04 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84436cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[661ddc93-84fc-4323-ad4a-419c688c2a36]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-b2cf04f7-46a5-462d-afed-d15dba75524c req-7c6113cc-80fa-4525-9d60-2dae0398bf36 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received event network-vif-unplugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b2cf04f7-46a5-462d-afed-d15dba75524c req-7c6113cc-80fa-4525-9d60-2dae0398bf36 service nova] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b2cf04f7-46a5-462d-afed-d15dba75524c req-7c6113cc-80fa-4525-9d60-2dae0398bf36 service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b2cf04f7-46a5-462d-afed-d15dba75524c req-7c6113cc-80fa-4525-9d60-2dae0398bf36 service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-b2cf04f7-46a5-462d-afed-d15dba75524c req-7c6113cc-80fa-4525-9d60-2dae0398bf36 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] No waiting events found dispatching network-vif-unplugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:04 user nova-compute[72409]: WARNING nova.compute.manager [req-b2cf04f7-46a5-462d-afed-d15dba75524c req-7c6113cc-80fa-4525-9d60-2dae0398bf36 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received unexpected event network-vif-unplugged-b699c9c4-31f5-41b2-ac73-16353dceb256 for instance with vm_state active and task_state resize_migrating.
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fac9baa-9a6d-4e45-a98e-d23ddbe83e03]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[daef2fce-0925-4c33-ae97-fa4bb324b30e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-f6761b27-e1f3-4f6e-a7e7-990910a3523b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-f6761b27-e1f3-4f6e-a7e7-990910a3523b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid f6761b27-e1f3-4f6e-a7e7-990910a3523b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd079d1-c56b-4151-a2f8-6a33d43847dc]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6163a8d5-4535da2e2593d9c4', '/dev/disk/by-id/scsi-23435333564613265', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6163a8d5') {{(pid=83250) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e261bd9-2a1a-48d7-8a34-773e42b31413]: (4, None) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa916d21-556e-400f-9709-785797efe869]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69c3bcb-bf97-4a27-b13c-1c6ca307bbe4]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260]
Aug 09 23:05:04 user nova-compute[72409]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260] successful.
Aug 09 23:05:04 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d9b1bb-b6e6-4c9c-b9aa-e6ae93ba262c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== disconnect_volume: return (364ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:05:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Updating instance_info_cache with network_info: [{"id": "94290ac9-5002-469d-babb-28d9d4adbaba", "address": "fa:16:3e:ac:30:2c", "network": {"id": "4ce575ab-a977-48a1-a305-3b5df321a3d3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1866075743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02446693acb409e81e2484a006ec6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94290ac9-50", "ovs_interfaceid": "94290ac9-5002-469d-babb-28d9d4adbaba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-f6761b27-e1f3-4f6e-a7e7-990910a3523b" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:05 user nova-compute[72409]: INFO nova.compute.manager [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Unshelving
Aug 09 23:05:05 user nova-compute[72409]: INFO nova.virt.block_device [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Booting with volume c4fec0e3-71b7-473e-b72a-5f9656c2c15f at /dev/vda
Aug 09 23:05:05 user nova-compute[72409]: DEBUG os_brick.utils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1df27b-ec1c-40e8-94aa-9a56ecb16cbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5425774e-871c-4426-ae69-a988f82a1ac5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6844a4c2-9a9f-445a-9e0f-d75b9ff8e19b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d50ea6-5ba9-4a70-9b60-ab8bef719f35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622290.6462533, 66750137-9d3c-476b-b21b-10032ab3d55d => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:05 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] VM Stopped (Lifecycle Event)
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:05:05 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[698b52db-5b32-455d-b72e-8624e2a96aed]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG os_brick.utils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updating existing volume attachment record: 0f731e95-31f3-475b-8338-683b196e8b0c {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-6983eb99-8b55-4151-aca6-fd35f9192736 None None] [instance: 66750137-9d3c-476b-b21b-10032ab3d55d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:05:06 user nova-compute[72409]: DEBUG nova.compute.manager [req-29ac6e25-07ad-4f9f-b224-266fca1b85fa req-03800a33-9c60-4b95-b907-dc23d51d73b2 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received event network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-29ac6e25-07ad-4f9f-b224-266fca1b85fa req-03800a33-9c60-4b95-b907-dc23d51d73b2 service nova] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-29ac6e25-07ad-4f9f-b224-266fca1b85fa req-03800a33-9c60-4b95-b907-dc23d51d73b2 service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-29ac6e25-07ad-4f9f-b224-266fca1b85fa req-03800a33-9c60-4b95-b907-dc23d51d73b2 service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:06 user nova-compute[72409]: DEBUG nova.compute.manager [req-29ac6e25-07ad-4f9f-b224-266fca1b85fa req-03800a33-9c60-4b95-b907-dc23d51d73b2 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] No waiting events found dispatching network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:06 user nova-compute[72409]: WARNING nova.compute.manager [req-29ac6e25-07ad-4f9f-b224-266fca1b85fa req-03800a33-9c60-4b95-b907-dc23d51d73b2 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received unexpected event network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 for instance with vm_state active and task_state resize_migrating.
Aug 09 23:05:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:05:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:09 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:05:09 user nova-compute[72409]: INFO nova.compute.claims [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Claim successful on node user
Aug 09 23:05:09 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:05:09 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:05:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:05:10 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:05:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG nova.policy [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '539168ee5b36474680b3e9fc785a2237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302ec6e31abf4e89847c80adbb45be87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:05:10 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Creating image(s)
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "/opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "/opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.160s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk 1073741824" returned: 0 in 0.058s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.154s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Cannot resize image /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG nova.objects.instance [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lazy-loading 'migration_context' on Instance uuid fbee7df5-5051-4064-bfa3-fa7a0da9c7aa {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Ensure instance console log exists: /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:12 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Successfully created port: 2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:05:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:05:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:05:12 user nova-compute[72409]: INFO nova.compute.claims [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Claim successful on node user
Aug 09 23:05:13 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG nova.network.neutron [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:05:13 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:05:13 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG nova.policy [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'feb2365fd49a41269597b3834e2ab2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409bb8521e054a8aa8d4eff42d529f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:05:13 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Creating image(s)
Aug 09 23:05:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "/opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "/opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "/opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.171s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk 1073741824" returned: 0 in 0.096s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.147s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Cannot resize image /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'migration_context' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Ensure instance console log exists: /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Successfully created port: 471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Successfully updated port: 2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "refresh_cache-fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquired lock "refresh_cache-fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-9bbf3391-6ca9-496d-8409-397f94b34f7f req-d3476da0-359b-45fd-9776-17334dcd5cd9 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Received event network-changed-2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-9bbf3391-6ca9-496d-8409-397f94b34f7f req-d3476da0-359b-45fd-9776-17334dcd5cd9 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Refreshing instance network info cache due to event network-changed-2a923c01-b708-4bc5-ae85-88372217085c. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9bbf3391-6ca9-496d-8409-397f94b34f7f req-d3476da0-359b-45fd-9776-17334dcd5cd9 service nova] Acquiring lock "refresh_cache-fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:14 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.network.neutron [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Updating instance_info_cache with network_info: [{"id": "2a923c01-b708-4bc5-ae85-88372217085c", "address": "fa:16:3e:36:7f:c2", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a923c01-b7", "ovs_interfaceid": "2a923c01-b708-4bc5-ae85-88372217085c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Releasing lock "refresh_cache-fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Instance network_info: |[{"id": "2a923c01-b708-4bc5-ae85-88372217085c", "address": "fa:16:3e:36:7f:c2", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a923c01-b7", "ovs_interfaceid": "2a923c01-b708-4bc5-ae85-88372217085c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9bbf3391-6ca9-496d-8409-397f94b34f7f req-d3476da0-359b-45fd-9776-17334dcd5cd9 service nova] Acquired lock "refresh_cache-fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.network.neutron [req-9bbf3391-6ca9-496d-8409-397f94b34f7f req-d3476da0-359b-45fd-9776-17334dcd5cd9 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Refreshing network info cache for port 2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Start _get_guest_xml network_info=[{"id": "2a923c01-b708-4bc5-ae85-88372217085c", "address": "fa:16:3e:36:7f:c2", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a923c01-b7", "ovs_interfaceid": "2a923c01-b708-4bc5-ae85-88372217085c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:05:15 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:15 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1045314638',display_name='tempest-VolumesSnapshotTestJSON-instance-1045314638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1045314638',id=34,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoo/KhKR5krjgCLVSiyQgei9VpHIE+2c7lL9AVwr6Q3vxbBgGjcDFlpCu27XNF6XnQaxN3rT8PGF06Zbf9Rwt+UgjycuCM0Y+M05AjQczcPkLboJ3AmvvjXOLcfYafYMg==',key_name='tempest-keypair-692076178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='302ec6e31abf4e89847c80adbb45be87',ramdisk_id='',reservation_id='r-k8i7dscd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-725320644',owner_user_name='tempest-VolumesSnapshotTestJSON-725320644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:05:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539168ee5b36474680b3e9fc785a2237',uuid=fbee7df5-5051-4064-bfa3-fa7a0da9c7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a923c01-b708-4bc5-ae85-88372217085c", "address": "fa:16:3e:36:7f:c2", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a923c01-b7", "ovs_interfaceid": "2a923c01-b708-4bc5-ae85-88372217085c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Converting VIF {"id": "2a923c01-b708-4bc5-ae85-88372217085c", "address": "fa:16:3e:36:7f:c2", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a923c01-b7", "ovs_interfaceid": "2a923c01-b708-4bc5-ae85-88372217085c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:7f:c2,bridge_name='br-int',has_traffic_filtering=True,id=2a923c01-b708-4bc5-ae85-88372217085c,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a923c01-b7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.objects.instance [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lazy-loading 'pci_devices' on Instance uuid fbee7df5-5051-4064-bfa3-fa7a0da9c7aa {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:05:15 user nova-compute[72409]:   <uuid>fbee7df5-5051-4064-bfa3-fa7a0da9c7aa</uuid>
Aug 09 23:05:15 user nova-compute[72409]:   <name>instance-00000022</name>
Aug 09 23:05:15 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:05:15 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:05:15 user nova-compute[72409]:   <metadata>
Aug 09 23:05:15 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:05:15 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:05:15 user nova-compute[72409]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1045314638</nova:name>
Aug 09 23:05:15 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:05:15</nova:creationTime>
Aug 09 23:05:15 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:05:15 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:05:15 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:05:15 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:05:15 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:05:15 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:05:15 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:05:15 user nova-compute[72409]:       <nova:owner>
Aug 09 23:05:15 user nova-compute[72409]:         <nova:user uuid="539168ee5b36474680b3e9fc785a2237">tempest-VolumesSnapshotTestJSON-725320644-project-member</nova:user>
Aug 09 23:05:15 user nova-compute[72409]:         <nova:project uuid="302ec6e31abf4e89847c80adbb45be87">tempest-VolumesSnapshotTestJSON-725320644</nova:project>
Aug 09 23:05:15 user nova-compute[72409]:       </nova:owner>
Aug 09 23:05:15 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:05:15 user nova-compute[72409]:       <nova:ports>
Aug 09 23:05:15 user nova-compute[72409]:         <nova:port uuid="2a923c01-b708-4bc5-ae85-88372217085c">
Aug 09 23:05:15 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 23:05:15 user nova-compute[72409]:         </nova:port>
Aug 09 23:05:15 user nova-compute[72409]:       </nova:ports>
Aug 09 23:05:15 user nova-compute[72409]:     </nova:instance>
Aug 09 23:05:15 user nova-compute[72409]:   </metadata>
Aug 09 23:05:15 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:05:15 user nova-compute[72409]:     <system>
Aug 09 23:05:15 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:05:15 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:05:15 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:05:15 user nova-compute[72409]:       <entry name="serial">fbee7df5-5051-4064-bfa3-fa7a0da9c7aa</entry>
Aug 09 23:05:15 user nova-compute[72409]:       <entry name="uuid">fbee7df5-5051-4064-bfa3-fa7a0da9c7aa</entry>
Aug 09 23:05:15 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:05:15 user nova-compute[72409]:     </system>
Aug 09 23:05:15 user nova-compute[72409]:   </sysinfo>
Aug 09 23:05:15 user nova-compute[72409]:   <os>
Aug 09 23:05:15 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:05:15 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:05:15 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:05:15 user nova-compute[72409]:   </os>
Aug 09 23:05:15 user nova-compute[72409]:   <features>
Aug 09 23:05:15 user nova-compute[72409]:     <acpi/>
Aug 09 23:05:15 user nova-compute[72409]:     <apic/>
Aug 09 23:05:15 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:05:15 user nova-compute[72409]:   </features>
Aug 09 23:05:15 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:05:15 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:05:15 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:05:15 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:05:15 user nova-compute[72409]:   </clock>
Aug 09 23:05:15 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:05:15 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:05:15 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:05:15 user nova-compute[72409]:   </cpu>
Aug 09 23:05:15 user nova-compute[72409]:   <devices>
Aug 09 23:05:15 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:05:15 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:05:15 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk"/>
Aug 09 23:05:15 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:05:15 user nova-compute[72409]:     </disk>
Aug 09 23:05:15 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:05:15 user nova-compute[72409]:       <mac address="fa:16:3e:36:7f:c2"/>
Aug 09 23:05:15 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:05:15 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:05:15 user nova-compute[72409]:       <target dev="tap2a923c01-b7"/>
Aug 09 23:05:15 user nova-compute[72409]:     </interface>
Aug 09 23:05:15 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:05:15 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/console.log" append="off"/>
Aug 09 23:05:15 user nova-compute[72409]:     </serial>
Aug 09 23:05:15 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:05:15 user nova-compute[72409]:     <video>
Aug 09 23:05:15 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:05:15 user nova-compute[72409]:     </video>
Aug 09 23:05:15 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:05:15 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:05:15 user nova-compute[72409]:     </rng>
Aug 09 23:05:15 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:05:15 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:05:15 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:05:15 user nova-compute[72409]:     </memballoon>
Aug 09 23:05:15 user nova-compute[72409]:   </devices>
Aug 09 23:05:15 user nova-compute[72409]: </domain>
Aug 09 23:05:15 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1045314638',display_name='tempest-VolumesSnapshotTestJSON-instance-1045314638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1045314638',id=34,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoo/KhKR5krjgCLVSiyQgei9VpHIE+2c7lL9AVwr6Q3vxbBgGjcDFlpCu27XNF6XnQaxN3rT8PGF06Zbf9Rwt+UgjycuCM0Y+M05AjQczcPkLboJ3AmvvjXOLcfYafYMg==',key_name='tempest-keypair-692076178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='302ec6e31abf4e89847c80adbb45be87',ramdisk_id='',reservation_id='r-k8i7dscd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-725320644',owner_user_name='tempest-VolumesSnapshotTestJSON-725320644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:05:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539168ee5b36474680b3e9fc785a2237',uuid=fbee7df5-5051-4064-bfa3-fa7a0da9c7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a923c01-b708-4bc5-ae85-88372217085c", "address": "fa:16:3e:36:7f:c2", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a923c01-b7", "ovs_interfaceid": "2a923c01-b708-4bc5-ae85-88372217085c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Converting VIF {"id": "2a923c01-b708-4bc5-ae85-88372217085c", "address": "fa:16:3e:36:7f:c2", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a923c01-b7", "ovs_interfaceid": "2a923c01-b708-4bc5-ae85-88372217085c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:7f:c2,bridge_name='br-int',has_traffic_filtering=True,id=2a923c01-b708-4bc5-ae85-88372217085c,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a923c01-b7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG os_vif [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:7f:c2,bridge_name='br-int',has_traffic_filtering=True,id=2a923c01-b708-4bc5-ae85-88372217085c,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a923c01-b7') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a923c01-b7, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a923c01-b7, col_values=(('external_ids', {'iface-id': '2a923c01-b708-4bc5-ae85-88372217085c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:7f:c2', 'vm-uuid': 'fbee7df5-5051-4064-bfa3-fa7a0da9c7aa'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:15 user nova-compute[72409]: INFO os_vif [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:7f:c2,bridge_name='br-int',has_traffic_filtering=True,id=2a923c01-b708-4bc5-ae85-88372217085c,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a923c01-b7')
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] No VIF found with MAC fa:16:3e:36:7f:c2, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.network.neutron [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Successfully updated port: 471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquired lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.network.neutron [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-fca6df19-ad7c-4f72-bd4c-21fe151fb4f1 req-9b3a5748-e54e-4fb5-9d19-54fb85f43364 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-changed-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.compute.manager [req-fca6df19-ad7c-4f72-bd4c-21fe151fb4f1 req-9b3a5748-e54e-4fb5-9d19-54fb85f43364 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Refreshing instance network info cache due to event network-changed-471b5fc0-921e-4944-b012-6d2cdcb0f246. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fca6df19-ad7c-4f72-bd4c-21fe151fb4f1 req-9b3a5748-e54e-4fb5-9d19-54fb85f43364 service nova] Acquiring lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:15 user nova-compute[72409]: DEBUG nova.network.neutron [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.network.neutron [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updating instance_info_cache with network_info: [{"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Releasing lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Instance network_info: |[{"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fca6df19-ad7c-4f72-bd4c-21fe151fb4f1 req-9b3a5748-e54e-4fb5-9d19-54fb85f43364 service nova] Acquired lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.network.neutron [req-fca6df19-ad7c-4f72-bd4c-21fe151fb4f1 req-9b3a5748-e54e-4fb5-9d19-54fb85f43364 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Refreshing network info cache for port 471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Start _get_guest_xml network_info=[{"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:05:16 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:16 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1160653917',display_name='tempest-ServerStableDeviceRescueTest-server-1160653917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1160653917',id=35,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnf38V2OuD96vJjhFZoJ5nm87MXR7+3d+L+cKtAMz4KfRBBR78yAxB8Mtao/xryU8hisujP277ogXOA2H+zoEvWtKW+FemUZhOHblLHBOi+JqiPbTlvQU0hppvOCFHjfA==',key_name='tempest-keypair-451174164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='409bb8521e054a8aa8d4eff42d529f49',ramdisk_id='',reservation_id='r-a1mshumj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1483667953',owner_user_name='tempest-ServerStableDeviceRescueTest-1483667953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:05:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feb2365fd49a41269597b3834e2ab2b6',uuid=a75a5458-8710-425d-9755-dc2dc71f7d5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Converting VIF {"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=471b5fc0-921e-4944-b012-6d2cdcb0f246,network=Network(8d9e93ae-10cf-42b4-a277-297161eb3559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5fc0-92') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.objects.instance [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'pci_devices' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:05:16 user nova-compute[72409]:   <uuid>a75a5458-8710-425d-9755-dc2dc71f7d5e</uuid>
Aug 09 23:05:16 user nova-compute[72409]:   <name>instance-00000023</name>
Aug 09 23:05:16 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:05:16 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:05:16 user nova-compute[72409]:   <metadata>
Aug 09 23:05:16 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:05:16 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:05:16 user nova-compute[72409]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1160653917</nova:name>
Aug 09 23:05:16 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:05:16</nova:creationTime>
Aug 09 23:05:16 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:05:16 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:05:16 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:05:16 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:05:16 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:05:16 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:05:16 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:05:16 user nova-compute[72409]:       <nova:owner>
Aug 09 23:05:16 user nova-compute[72409]:         <nova:user uuid="feb2365fd49a41269597b3834e2ab2b6">tempest-ServerStableDeviceRescueTest-1483667953-project-member</nova:user>
Aug 09 23:05:16 user nova-compute[72409]:         <nova:project uuid="409bb8521e054a8aa8d4eff42d529f49">tempest-ServerStableDeviceRescueTest-1483667953</nova:project>
Aug 09 23:05:16 user nova-compute[72409]:       </nova:owner>
Aug 09 23:05:16 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:05:16 user nova-compute[72409]:       <nova:ports>
Aug 09 23:05:16 user nova-compute[72409]:         <nova:port uuid="471b5fc0-921e-4944-b012-6d2cdcb0f246">
Aug 09 23:05:16 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 23:05:16 user nova-compute[72409]:         </nova:port>
Aug 09 23:05:16 user nova-compute[72409]:       </nova:ports>
Aug 09 23:05:16 user nova-compute[72409]:     </nova:instance>
Aug 09 23:05:16 user nova-compute[72409]:   </metadata>
Aug 09 23:05:16 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:05:16 user nova-compute[72409]:     <system>
Aug 09 23:05:16 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:05:16 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:05:16 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:05:16 user nova-compute[72409]:       <entry name="serial">a75a5458-8710-425d-9755-dc2dc71f7d5e</entry>
Aug 09 23:05:16 user nova-compute[72409]:       <entry name="uuid">a75a5458-8710-425d-9755-dc2dc71f7d5e</entry>
Aug 09 23:05:16 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:05:16 user nova-compute[72409]:     </system>
Aug 09 23:05:16 user nova-compute[72409]:   </sysinfo>
Aug 09 23:05:16 user nova-compute[72409]:   <os>
Aug 09 23:05:16 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:05:16 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:05:16 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:05:16 user nova-compute[72409]:   </os>
Aug 09 23:05:16 user nova-compute[72409]:   <features>
Aug 09 23:05:16 user nova-compute[72409]:     <acpi/>
Aug 09 23:05:16 user nova-compute[72409]:     <apic/>
Aug 09 23:05:16 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:05:16 user nova-compute[72409]:   </features>
Aug 09 23:05:16 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:05:16 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:05:16 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:05:16 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:05:16 user nova-compute[72409]:   </clock>
Aug 09 23:05:16 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:05:16 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:05:16 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:05:16 user nova-compute[72409]:   </cpu>
Aug 09 23:05:16 user nova-compute[72409]:   <devices>
Aug 09 23:05:16 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:05:16 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:05:16 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk"/>
Aug 09 23:05:16 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:05:16 user nova-compute[72409]:     </disk>
Aug 09 23:05:16 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:05:16 user nova-compute[72409]:       <mac address="fa:16:3e:15:28:f7"/>
Aug 09 23:05:16 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:05:16 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:05:16 user nova-compute[72409]:       <target dev="tap471b5fc0-92"/>
Aug 09 23:05:16 user nova-compute[72409]:     </interface>
Aug 09 23:05:16 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:05:16 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/console.log" append="off"/>
Aug 09 23:05:16 user nova-compute[72409]:     </serial>
Aug 09 23:05:16 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:05:16 user nova-compute[72409]:     <video>
Aug 09 23:05:16 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:05:16 user nova-compute[72409]:     </video>
Aug 09 23:05:16 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:05:16 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:05:16 user nova-compute[72409]:     </rng>
Aug 09 23:05:16 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:05:16 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:05:16 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:05:16 user nova-compute[72409]:     </memballoon>
Aug 09 23:05:16 user nova-compute[72409]:   </devices>
Aug 09 23:05:16 user nova-compute[72409]: </domain>
Aug 09 23:05:16 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1160653917',display_name='tempest-ServerStableDeviceRescueTest-server-1160653917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1160653917',id=35,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnf38V2OuD96vJjhFZoJ5nm87MXR7+3d+L+cKtAMz4KfRBBR78yAxB8Mtao/xryU8hisujP277ogXOA2H+zoEvWtKW+FemUZhOHblLHBOi+JqiPbTlvQU0hppvOCFHjfA==',key_name='tempest-keypair-451174164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='409bb8521e054a8aa8d4eff42d529f49',ramdisk_id='',reservation_id='r-a1mshumj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1483667953',owner_user_name='tempest-ServerStableDeviceRescueTest-1483667953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:05:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feb2365fd49a41269597b3834e2ab2b6',uuid=a75a5458-8710-425d-9755-dc2dc71f7d5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Converting VIF {"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=471b5fc0-921e-4944-b012-6d2cdcb0f246,network=Network(8d9e93ae-10cf-42b4-a277-297161eb3559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5fc0-92') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG os_vif [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=471b5fc0-921e-4944-b012-6d2cdcb0f246,network=Network(8d9e93ae-10cf-42b4-a277-297161eb3559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5fc0-92') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap471b5fc0-92, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap471b5fc0-92, col_values=(('external_ids', {'iface-id': '471b5fc0-921e-4944-b012-6d2cdcb0f246', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:28:f7', 'vm-uuid': 'a75a5458-8710-425d-9755-dc2dc71f7d5e'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:16 user nova-compute[72409]: INFO os_vif [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=471b5fc0-921e-4944-b012-6d2cdcb0f246,network=Network(8d9e93ae-10cf-42b4-a277-297161eb3559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5fc0-92')
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] No VIF found with MAC fa:16:3e:15:28:f7, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.network.neutron [req-9bbf3391-6ca9-496d-8409-397f94b34f7f req-d3476da0-359b-45fd-9776-17334dcd5cd9 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Updated VIF entry in instance network info cache for port 2a923c01-b708-4bc5-ae85-88372217085c. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.network.neutron [req-9bbf3391-6ca9-496d-8409-397f94b34f7f req-d3476da0-359b-45fd-9776-17334dcd5cd9 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Updating instance_info_cache with network_info: [{"id": "2a923c01-b708-4bc5-ae85-88372217085c", "address": "fa:16:3e:36:7f:c2", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a923c01-b7", "ovs_interfaceid": "2a923c01-b708-4bc5-ae85-88372217085c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9bbf3391-6ca9-496d-8409-397f94b34f7f req-d3476da0-359b-45fd-9776-17334dcd5cd9 service nova] Releasing lock "refresh_cache-fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.network.neutron [req-fca6df19-ad7c-4f72-bd4c-21fe151fb4f1 req-9b3a5748-e54e-4fb5-9d19-54fb85f43364 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updated VIF entry in instance network info cache for port 471b5fc0-921e-4944-b012-6d2cdcb0f246. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG nova.network.neutron [req-fca6df19-ad7c-4f72-bd4c-21fe151fb4f1 req-9b3a5748-e54e-4fb5-9d19-54fb85f43364 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updating instance_info_cache with network_info: [{"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fca6df19-ad7c-4f72-bd4c-21fe151fb4f1 req-9b3a5748-e54e-4fb5-9d19-54fb85f43364 service nova] Releasing lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:17 user nova-compute[72409]: INFO nova.compute.manager [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Terminating instance
Aug 09 23:05:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-9dcbc053-f32b-41a2-81b4-31067eec7d52 req-5b245246-1bb4-4a6f-8163-0516080c77e1 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Received event network-vif-plugged-2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9dcbc053-f32b-41a2-81b4-31067eec7d52 req-5b245246-1bb4-4a6f-8163-0516080c77e1 service nova] Acquiring lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9dcbc053-f32b-41a2-81b4-31067eec7d52 req-5b245246-1bb4-4a6f-8163-0516080c77e1 service nova] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9dcbc053-f32b-41a2-81b4-31067eec7d52 req-5b245246-1bb4-4a6f-8163-0516080c77e1 service nova] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-9dcbc053-f32b-41a2-81b4-31067eec7d52 req-5b245246-1bb4-4a6f-8163-0516080c77e1 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] No waiting events found dispatching network-vif-plugged-2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:17 user nova-compute[72409]: WARNING nova.compute.manager [req-9dcbc053-f32b-41a2-81b4-31067eec7d52 req-5b245246-1bb4-4a6f-8163-0516080c77e1 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Received unexpected event network-vif-plugged-2a923c01-b708-4bc5-ae85-88372217085c for instance with vm_state building and task_state spawning.
Aug 09 23:05:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-72d8d372-6191-4b60-8334-9f1466ac0167 req-e66b3b81-5f4a-42c8-992e-0a4faff50f45 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Received event network-vif-unplugged-94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-72d8d372-6191-4b60-8334-9f1466ac0167 req-e66b3b81-5f4a-42c8-992e-0a4faff50f45 service nova] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-72d8d372-6191-4b60-8334-9f1466ac0167 req-e66b3b81-5f4a-42c8-992e-0a4faff50f45 service nova] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-72d8d372-6191-4b60-8334-9f1466ac0167 req-e66b3b81-5f4a-42c8-992e-0a4faff50f45 service nova] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-72d8d372-6191-4b60-8334-9f1466ac0167 req-e66b3b81-5f4a-42c8-992e-0a4faff50f45 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] No waiting events found dispatching network-vif-unplugged-94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:17 user nova-compute[72409]: DEBUG nova.compute.manager [req-72d8d372-6191-4b60-8334-9f1466ac0167 req-e66b3b81-5f4a-42c8-992e-0a4faff50f45 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Received event network-vif-unplugged-94290ac9-5002-469d-babb-28d9d4adbaba for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:18 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Instance destroyed successfully.
Aug 09 23:05:18 user nova-compute[72409]: DEBUG nova.objects.instance [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lazy-loading 'resources' on Instance uuid f6761b27-e1f3-4f6e-a7e7-990910a3523b {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-571125330',display_name='tempest-TestServerVolumeAttachmentScenario-server-571125330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-571125330',id=29,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGONOUwxVKM4+YKyjgkpQ4QvUnX7IXAVu6XIapZY4ba4wPrGDZqnB38jcPyUIn+ocEz8eBKFt3caRzSfI+MDvjdgiWhoU9BNeUSsHAGvmnCaWBGSoDYIinHxmdx4ZfChbQ==',key_name='tempest-keypair-414375781',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d02446693acb409e81e2484a006ec6f0',ramdisk_id='',reservation_id='r-z5bff21h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-678273191',owner_user_name='tempest-TestServerVolumeAttachmentScenario-678273191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a397a72346b447c2a6947599c46efd46',uuid=f6761b27-e1f3-4f6e-a7e7-990910a3523b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94290ac9-5002-469d-babb-28d9d4adbaba", "address": "fa:16:3e:ac:30:2c", "network": {"id": "4ce575ab-a977-48a1-a305-3b5df321a3d3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1866075743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02446693acb409e81e2484a006ec6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94290ac9-50", "ovs_interfaceid": "94290ac9-5002-469d-babb-28d9d4adbaba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Converting VIF {"id": "94290ac9-5002-469d-babb-28d9d4adbaba", "address": "fa:16:3e:ac:30:2c", "network": {"id": "4ce575ab-a977-48a1-a305-3b5df321a3d3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1866075743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d02446693acb409e81e2484a006ec6f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94290ac9-50", "ovs_interfaceid": "94290ac9-5002-469d-babb-28d9d4adbaba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:30:2c,bridge_name='br-int',has_traffic_filtering=True,id=94290ac9-5002-469d-babb-28d9d4adbaba,network=Network(4ce575ab-a977-48a1-a305-3b5df321a3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94290ac9-50') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG os_vif [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:30:2c,bridge_name='br-int',has_traffic_filtering=True,id=94290ac9-5002-469d-babb-28d9d4adbaba,network=Network(4ce575ab-a977-48a1-a305-3b5df321a3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94290ac9-50') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94290ac9-50, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:18 user nova-compute[72409]: INFO os_vif [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:30:2c,bridge_name='br-int',has_traffic_filtering=True,id=94290ac9-5002-469d-babb-28d9d4adbaba,network=Network(4ce575ab-a977-48a1-a305-3b5df321a3d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94290ac9-50')
Aug 09 23:05:18 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Deleting instance files /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b_del
Aug 09 23:05:18 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Deletion of /opt/stack/data/nova/instances/f6761b27-e1f3-4f6e-a7e7-990910a3523b_del complete
Aug 09 23:05:18 user nova-compute[72409]: DEBUG nova.network.neutron [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Port b699c9c4-31f5-41b2-ac73-16353dceb256 binding to destination host user is already ACTIVE {{(pid=72409) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 23:05:18 user nova-compute[72409]: INFO nova.compute.manager [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Took 1.50 seconds to destroy the instance on the hypervisor.
Aug 09 23:05:18 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquired lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG nova.network.neutron [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'flavor' on Instance uuid c0f72ca0-06ef-444d-97d4-fca49bdde831 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:05:19 user nova-compute[72409]: INFO nova.compute.claims [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Claim successful on node user
Aug 09 23:05:19 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622304.0712051, b0c67c33-9d1a-4479-a64f-8f867330b9dc => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:19 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] VM Stopped (Lifecycle Event)
Aug 09 23:05:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-06716720-eadd-42ad-8047-6742348c945e None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-06716720-eadd-42ad-8047-6742348c945e None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_migrated, current DB power_state: 1, VM power_state: 4 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:19 user nova-compute[72409]: INFO nova.compute.manager [None req-06716720-eadd-42ad-8047-6742348c945e None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] During sync_power_state the instance has a pending task (resize_migrated). Skip.
Aug 09 23:05:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:19 user nova-compute[72409]: INFO nova.compute.manager [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Attaching volume a12b857d-36ba-4bb9-8d0f-6e71f640daed to /dev/vdb
Aug 09 23:05:19 user nova-compute[72409]: DEBUG os_brick.utils [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG nova.network.neutron [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updating instance_info_cache with network_info: [{"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccc4d72-634b-4df6-ae8f-f93fb4ab590e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Releasing lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.034s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad14766-35c1-4fd5-80ac-d138469dd434]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35285d3-9a01-4bdc-beb0-03a4ae0ef860]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4715a4-5ff1-4566-9c5f-0363af227077]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG os_brick.utils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG nova.compute.manager [req-59e93a58-ae25-4b73-9ea7-6740e6aa4681 req-d29cf033-7e98-4b61-bc01-6a0d0bb1c8c5 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Received event network-vif-plugged-2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-59e93a58-ae25-4b73-9ea7-6740e6aa4681 req-d29cf033-7e98-4b61-bc01-6a0d0bb1c8c5 service nova] Acquiring lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-59e93a58-ae25-4b73-9ea7-6740e6aa4681 req-d29cf033-7e98-4b61-bc01-6a0d0bb1c8c5 service nova] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-59e93a58-ae25-4b73-9ea7-6740e6aa4681 req-d29cf033-7e98-4b61-bc01-6a0d0bb1c8c5 service nova] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG nova.compute.manager [req-59e93a58-ae25-4b73-9ea7-6740e6aa4681 req-d29cf033-7e98-4b61-bc01-6a0d0bb1c8c5 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] No waiting events found dispatching network-vif-plugged-2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:19 user nova-compute[72409]: WARNING nova.compute.manager [req-59e93a58-ae25-4b73-9ea7-6740e6aa4681 req-d29cf033-7e98-4b61-bc01-6a0d0bb1c8c5 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Received unexpected event network-vif-plugged-2a923c01-b708-4bc5-ae85-88372217085c for instance with vm_state building and task_state spawning.
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:05:19 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc27d8c1-9365-4077-a8fb-d1ed669b8ba0]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG os_brick.utils [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] <== get_connector_properties: return (329ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updating existing volume attachment record: f65f5828-0205-4526-b935-600e0c9a4a1e {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dd1b89-ace2-4a82-90e7-f35a860343bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.038s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[366deaee-8529-46b6-b9fd-5385f268e128]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b51a6d-b0c1-4157-9583-2a74686f0634]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d2dc8e-2d7c-45c6-80c2-082032ef2bd1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:05:19 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7339a8f2-b4c1-4dc8-b1ff-af2359d82fc9]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG os_brick.utils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== get_connector_properties: return (358ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.059s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG nova.compute.manager [req-b016fe3f-7c6b-4b01-91e2-09fdb4d37619 req-4bfdc45b-1cc9-4885-9c0a-786899a7ed51 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Received event network-vif-plugged-94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b016fe3f-7c6b-4b01-91e2-09fdb4d37619 req-4bfdc45b-1cc9-4885-9c0a-786899a7ed51 service nova] Acquiring lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b016fe3f-7c6b-4b01-91e2-09fdb4d37619 req-4bfdc45b-1cc9-4885-9c0a-786899a7ed51 service nova] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b016fe3f-7c6b-4b01-91e2-09fdb4d37619 req-4bfdc45b-1cc9-4885-9c0a-786899a7ed51 service nova] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG nova.compute.manager [req-b016fe3f-7c6b-4b01-91e2-09fdb4d37619 req-4bfdc45b-1cc9-4885-9c0a-786899a7ed51 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] No waiting events found dispatching network-vif-plugged-94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:20 user nova-compute[72409]: WARNING nova.compute.manager [req-b016fe3f-7c6b-4b01-91e2-09fdb4d37619 req-4bfdc45b-1cc9-4885-9c0a-786899a7ed51 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Received unexpected event network-vif-plugged-94290ac9-5002-469d-babb-28d9d4adbaba for instance with vm_state active and task_state deleting.
Aug 09 23:05:20 user nova-compute[72409]: DEBUG nova.compute.manager [req-ecbbdf77-2e9d-4abf-a800-9bf608293241 req-2404da96-989e-4eb0-ad40-879dde927c34 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ecbbdf77-2e9d-4abf-a800-9bf608293241 req-2404da96-989e-4eb0-ad40-879dde927c34 service nova] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ecbbdf77-2e9d-4abf-a800-9bf608293241 req-2404da96-989e-4eb0-ad40-879dde927c34 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ecbbdf77-2e9d-4abf-a800-9bf608293241 req-2404da96-989e-4eb0-ad40-879dde927c34 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG nova.compute.manager [req-ecbbdf77-2e9d-4abf-a800-9bf608293241 req-2404da96-989e-4eb0-ad40-879dde927c34 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] No waiting events found dispatching network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:20 user nova-compute[72409]: WARNING nova.compute.manager [req-ecbbdf77-2e9d-4abf-a800-9bf608293241 req-2404da96-989e-4eb0-ad40-879dde927c34 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received unexpected event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 for instance with vm_state building and task_state spawning.
Aug 09 23:05:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG nova.network.neutron [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:20 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:05:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG nova.policy [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de2d9f7ad5bb4a93ab61ab100eb1778d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41897ed2b644775a5dcb22d1ecd60a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:05:20 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Creating image(s)
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "/opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "/opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.179s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.161s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk 1073741824" returned: 0 in 0.097s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "a074c83c-2e90-4675-89dc-4006294cfdee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:05:21 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Took 2.56 seconds to deallocate network for instance.
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.171s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Cannot resize image /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'migration_context' on Instance uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Ensure instance console log exists: /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.network.neutron [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Successfully created port: 7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.446s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:05:21 user nova-compute[72409]: INFO nova.compute.claims [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Claim successful on node user
Aug 09 23:05:21 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Deleted allocations for instance f6761b27-e1f3-4f6e-a7e7-990910a3523b
Aug 09 23:05:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3c2b1f7e-6cc1-457d-9ef4-ba4260c18db8 tempest-TestServerVolumeAttachmentScenario-678273191 tempest-TestServerVolumeAttachmentScenario-678273191-project-member] Lock "f6761b27-e1f3-4f6e-a7e7-990910a3523b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.821s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622321.9494138, fbee7df5-5051-4064-bfa3-fa7a0da9c7aa => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:21 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] VM Resumed (Lifecycle Event)
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:05:21 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Instance spawned successfully.
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622321.9497008, fbee7df5-5051-4064-bfa3-fa7a0da9c7aa => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] VM Started (Lifecycle Event)
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.compute.manager [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Took 11.94 seconds to spawn the instance on the hypervisor.
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-1b1c03b0-d5f6-4282-b3c3-dbcbba1bb7cd req-3cec949c-d566-4eb9-987d-39481523e9d0 service nova] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Received event network-vif-deleted-94290ac9-5002-469d-babb-28d9d4adbaba {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-1b1c03b0-d5f6-4282-b3c3-dbcbba1bb7cd req-3cec949c-d566-4eb9-987d-39481523e9d0 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1b1c03b0-d5f6-4282-b3c3-dbcbba1bb7cd req-3cec949c-d566-4eb9-987d-39481523e9d0 service nova] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1b1c03b0-d5f6-4282-b3c3-dbcbba1bb7cd req-3cec949c-d566-4eb9-987d-39481523e9d0 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1b1c03b0-d5f6-4282-b3c3-dbcbba1bb7cd req-3cec949c-d566-4eb9-987d-39481523e9d0 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-1b1c03b0-d5f6-4282-b3c3-dbcbba1bb7cd req-3cec949c-d566-4eb9-987d-39481523e9d0 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] No waiting events found dispatching network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:22 user nova-compute[72409]: WARNING nova.compute.manager [req-1b1c03b0-d5f6-4282-b3c3-dbcbba1bb7cd req-3cec949c-d566-4eb9-987d-39481523e9d0 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received unexpected event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 for instance with vm_state building and task_state spawning.
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.compute.manager [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Took 12.80 seconds to build instance.
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622322.2656176, a75a5458-8710-425d-9755-dc2dc71f7d5e => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] VM Resumed (Lifecycle Event)
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0b237e3c-a454-4430-9df4-1259b180374c tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.978s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Instance spawned successfully.
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622322.2658718, a75a5458-8710-425d-9755-dc2dc71f7d5e => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] VM Started (Lifecycle Event)
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.network.neutron [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Successfully updated port: 7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquired lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.network.neutron [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-6030f3ec-f31a-48ad-b209-8bf510ea910c req-dabb4642-921a-4757-8671-683e1a0e661c service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-changed-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-6030f3ec-f31a-48ad-b209-8bf510ea910c req-dabb4642-921a-4757-8671-683e1a0e661c service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Refreshing instance network info cache due to event network-changed-7854b9ac-e7ec-486d-9e13-de3581f75379. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6030f3ec-f31a-48ad-b209-8bf510ea910c req-dabb4642-921a-4757-8671-683e1a0e661c service nova] Acquiring lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.compute.manager [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Took 8.92 seconds to spawn the instance on the hypervisor.
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.network.neutron [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.policy [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de2d9f7ad5bb4a93ab61ab100eb1778d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41897ed2b644775a5dcb22d1ecd60a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Creating image(s)
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "/opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "/opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "/opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:22 user nova-compute[72409]: INFO nova.compute.manager [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Took 9.82 seconds to build instance.
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ad1b20f8-36d7-45db-8aef-a7a921630e01 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.964s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.157s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.184s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.network.neutron [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Updating instance_info_cache with network_info: [{"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk 1073741824" returned: 0 in 0.074s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Releasing lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Instance network_info: |[{"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6030f3ec-f31a-48ad-b209-8bf510ea910c req-dabb4642-921a-4757-8671-683e1a0e661c service nova] Acquired lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.network.neutron [req-6030f3ec-f31a-48ad-b209-8bf510ea910c req-dabb4642-921a-4757-8671-683e1a0e661c service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Refreshing network info cache for port 7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Start _get_guest_xml network_info=[{"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:05:23 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:23 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-450043224',display_name='tempest-ServerRescueNegativeTestJSON-server-450043224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-450043224',id=36,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d41897ed2b644775a5dcb22d1ecd60a0',ramdisk_id='',reservation_id='r-l9q8760o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-850997564',owner_user_name='tempest-ServerRescueNegativeTestJSON-850997564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:05:20Z,user_data=None,user_id='de2d9f7ad5bb4a93ab61ab100eb1778d',uuid=8f7e2151-3d32-4ec8-9903-f5f284879ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converting VIF {"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:78:71,bridge_name='br-int',has_traffic_filtering=True,id=7854b9ac-e7ec-486d-9e13-de3581f75379,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7854b9ac-e7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:05:23 user nova-compute[72409]:   <uuid>8f7e2151-3d32-4ec8-9903-f5f284879ae0</uuid>
Aug 09 23:05:23 user nova-compute[72409]:   <name>instance-00000024</name>
Aug 09 23:05:23 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:05:23 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:05:23 user nova-compute[72409]:   <metadata>
Aug 09 23:05:23 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:05:23 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:05:23 user nova-compute[72409]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-450043224</nova:name>
Aug 09 23:05:23 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:05:23</nova:creationTime>
Aug 09 23:05:23 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:05:23 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:05:23 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:05:23 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:05:23 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:05:23 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:05:23 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:05:23 user nova-compute[72409]:       <nova:owner>
Aug 09 23:05:23 user nova-compute[72409]:         <nova:user uuid="de2d9f7ad5bb4a93ab61ab100eb1778d">tempest-ServerRescueNegativeTestJSON-850997564-project-member</nova:user>
Aug 09 23:05:23 user nova-compute[72409]:         <nova:project uuid="d41897ed2b644775a5dcb22d1ecd60a0">tempest-ServerRescueNegativeTestJSON-850997564</nova:project>
Aug 09 23:05:23 user nova-compute[72409]:       </nova:owner>
Aug 09 23:05:23 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:05:23 user nova-compute[72409]:       <nova:ports>
Aug 09 23:05:23 user nova-compute[72409]:         <nova:port uuid="7854b9ac-e7ec-486d-9e13-de3581f75379">
Aug 09 23:05:23 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 23:05:23 user nova-compute[72409]:         </nova:port>
Aug 09 23:05:23 user nova-compute[72409]:       </nova:ports>
Aug 09 23:05:23 user nova-compute[72409]:     </nova:instance>
Aug 09 23:05:23 user nova-compute[72409]:   </metadata>
Aug 09 23:05:23 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:05:23 user nova-compute[72409]:     <system>
Aug 09 23:05:23 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:05:23 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:05:23 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:05:23 user nova-compute[72409]:       <entry name="serial">8f7e2151-3d32-4ec8-9903-f5f284879ae0</entry>
Aug 09 23:05:23 user nova-compute[72409]:       <entry name="uuid">8f7e2151-3d32-4ec8-9903-f5f284879ae0</entry>
Aug 09 23:05:23 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:05:23 user nova-compute[72409]:     </system>
Aug 09 23:05:23 user nova-compute[72409]:   </sysinfo>
Aug 09 23:05:23 user nova-compute[72409]:   <os>
Aug 09 23:05:23 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:05:23 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:05:23 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:05:23 user nova-compute[72409]:   </os>
Aug 09 23:05:23 user nova-compute[72409]:   <features>
Aug 09 23:05:23 user nova-compute[72409]:     <acpi/>
Aug 09 23:05:23 user nova-compute[72409]:     <apic/>
Aug 09 23:05:23 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:05:23 user nova-compute[72409]:   </features>
Aug 09 23:05:23 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:05:23 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:05:23 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:05:23 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:05:23 user nova-compute[72409]:   </clock>
Aug 09 23:05:23 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:05:23 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:05:23 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:05:23 user nova-compute[72409]:   </cpu>
Aug 09 23:05:23 user nova-compute[72409]:   <devices>
Aug 09 23:05:23 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:05:23 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:05:23 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk"/>
Aug 09 23:05:23 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:05:23 user nova-compute[72409]:     </disk>
Aug 09 23:05:23 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:05:23 user nova-compute[72409]:       <mac address="fa:16:3e:aa:78:71"/>
Aug 09 23:05:23 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:05:23 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:05:23 user nova-compute[72409]:       <target dev="tap7854b9ac-e7"/>
Aug 09 23:05:23 user nova-compute[72409]:     </interface>
Aug 09 23:05:23 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:05:23 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/console.log" append="off"/>
Aug 09 23:05:23 user nova-compute[72409]:     </serial>
Aug 09 23:05:23 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:05:23 user nova-compute[72409]:     <video>
Aug 09 23:05:23 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:05:23 user nova-compute[72409]:     </video>
Aug 09 23:05:23 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:05:23 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:05:23 user nova-compute[72409]:     </rng>
Aug 09 23:05:23 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:05:23 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:05:23 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:05:23 user nova-compute[72409]:     </memballoon>
Aug 09 23:05:23 user nova-compute[72409]:   </devices>
Aug 09 23:05:23 user nova-compute[72409]: </domain>
Aug 09 23:05:23 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-450043224',display_name='tempest-ServerRescueNegativeTestJSON-server-450043224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-450043224',id=36,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d41897ed2b644775a5dcb22d1ecd60a0',ramdisk_id='',reservation_id='r-l9q8760o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-850997564',owner_user_name='tempest-ServerRescueNegativeTestJSON-850997564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:05:20Z,user_data=None,user_id='de2d9f7ad5bb4a93ab61ab100eb1778d',uuid=8f7e2151-3d32-4ec8-9903-f5f284879ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converting VIF {"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:78:71,bridge_name='br-int',has_traffic_filtering=True,id=7854b9ac-e7ec-486d-9e13-de3581f75379,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7854b9ac-e7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG os_vif [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:78:71,bridge_name='br-int',has_traffic_filtering=True,id=7854b9ac-e7ec-486d-9e13-de3581f75379,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7854b9ac-e7') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.211s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7854b9ac-e7, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7854b9ac-e7, col_values=(('external_ids', {'iface-id': '7854b9ac-e7ec-486d-9e13-de3581f75379', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:78:71', 'vm-uuid': '8f7e2151-3d32-4ec8-9903-f5f284879ae0'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:23 user nova-compute[72409]: INFO os_vif [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:78:71,bridge_name='br-int',has_traffic_filtering=True,id=7854b9ac-e7ec-486d-9e13-de3581f75379,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7854b9ac-e7')
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Successfully created port: 7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No VIF found with MAC fa:16:3e:aa:78:71, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Cannot resize image /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'migration_context' on Instance uuid a074c83c-2e90-4675-89dc-4006294cfdee {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Ensure instance console log exists: /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.network.neutron [req-6030f3ec-f31a-48ad-b209-8bf510ea910c req-dabb4642-921a-4757-8671-683e1a0e661c service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Updated VIF entry in instance network info cache for port 7854b9ac-e7ec-486d-9e13-de3581f75379. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG nova.network.neutron [req-6030f3ec-f31a-48ad-b209-8bf510ea910c req-dabb4642-921a-4757-8671-683e1a0e661c service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Updating instance_info_cache with network_info: [{"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6030f3ec-f31a-48ad-b209-8bf510ea910c req-dabb4642-921a-4757-8671-683e1a0e661c service nova] Releasing lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:24 user nova-compute[72409]: DEBUG nova.objects.instance [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lazy-loading 'pci_requests' on Instance uuid 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:24 user nova-compute[72409]: DEBUG nova.objects.instance [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lazy-loading 'numa_topology' on Instance uuid 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:24 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:05:24 user nova-compute[72409]: INFO nova.compute.claims [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Claim successful on node user
Aug 09 23:05:24 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Successfully updated port: 7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:05:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquired lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:24 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:05:24 user nova-compute[72409]: DEBUG nova.compute.manager [req-5bf60934-2e97-48c0-9bb6-2767ab6e322e req-e4399c03-1e6c-4de1-8f85-82ca71a198e1 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received event network-changed-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:24 user nova-compute[72409]: DEBUG nova.compute.manager [req-5bf60934-2e97-48c0-9bb6-2767ab6e322e req-e4399c03-1e6c-4de1-8f85-82ca71a198e1 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Refreshing instance network info cache due to event network-changed-7849914d-f21b-4fcc-b83c-47dc070987ec. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:05:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5bf60934-2e97-48c0-9bb6-2767ab6e322e req-e4399c03-1e6c-4de1-8f85-82ca71a198e1 service nova] Acquiring lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:24 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.093s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:25 user nova-compute[72409]: INFO nova.network.neutron [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updating port f26d04f1-ec38-48a6-840e-cf9d48203a37 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Updating instance_info_cache with network_info: [{"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Releasing lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Instance network_info: |[{"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5bf60934-2e97-48c0-9bb6-2767ab6e322e req-e4399c03-1e6c-4de1-8f85-82ca71a198e1 service nova] Acquired lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.network.neutron [req-5bf60934-2e97-48c0-9bb6-2767ab6e322e req-e4399c03-1e6c-4de1-8f85-82ca71a198e1 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Refreshing network info cache for port 7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Start _get_guest_xml network_info=[{"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:05:25 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:25 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2016255152',display_name='tempest-ServerRescueNegativeTestJSON-server-2016255152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2016255152',id=37,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d41897ed2b644775a5dcb22d1ecd60a0',ramdisk_id='',reservation_id='r-zlpivyg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-850997564',owner_user_name='tempest-ServerRescueNegativeTestJSON-850997564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:05:22Z,user_data=None,user_id='de2d9f7ad5bb4a93ab61ab100eb1778d',uuid=a074c83c-2e90-4675-89dc-4006294cfdee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converting VIF {"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:d5:11,bridge_name='br-int',has_traffic_filtering=True,id=7849914d-f21b-4fcc-b83c-47dc070987ec,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7849914d-f2') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'pci_devices' on Instance uuid a074c83c-2e90-4675-89dc-4006294cfdee {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:05:25 user nova-compute[72409]:   <uuid>a074c83c-2e90-4675-89dc-4006294cfdee</uuid>
Aug 09 23:05:25 user nova-compute[72409]:   <name>instance-00000025</name>
Aug 09 23:05:25 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:05:25 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:05:25 user nova-compute[72409]:   <metadata>
Aug 09 23:05:25 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:05:25 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:05:25 user nova-compute[72409]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2016255152</nova:name>
Aug 09 23:05:25 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:05:25</nova:creationTime>
Aug 09 23:05:25 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:05:25 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:05:25 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:05:25 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:05:25 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:05:25 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:05:25 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:05:25 user nova-compute[72409]:       <nova:owner>
Aug 09 23:05:25 user nova-compute[72409]:         <nova:user uuid="de2d9f7ad5bb4a93ab61ab100eb1778d">tempest-ServerRescueNegativeTestJSON-850997564-project-member</nova:user>
Aug 09 23:05:25 user nova-compute[72409]:         <nova:project uuid="d41897ed2b644775a5dcb22d1ecd60a0">tempest-ServerRescueNegativeTestJSON-850997564</nova:project>
Aug 09 23:05:25 user nova-compute[72409]:       </nova:owner>
Aug 09 23:05:25 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:05:25 user nova-compute[72409]:       <nova:ports>
Aug 09 23:05:25 user nova-compute[72409]:         <nova:port uuid="7849914d-f21b-4fcc-b83c-47dc070987ec">
Aug 09 23:05:25 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 23:05:25 user nova-compute[72409]:         </nova:port>
Aug 09 23:05:25 user nova-compute[72409]:       </nova:ports>
Aug 09 23:05:25 user nova-compute[72409]:     </nova:instance>
Aug 09 23:05:25 user nova-compute[72409]:   </metadata>
Aug 09 23:05:25 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:05:25 user nova-compute[72409]:     <system>
Aug 09 23:05:25 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:05:25 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:05:25 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:05:25 user nova-compute[72409]:       <entry name="serial">a074c83c-2e90-4675-89dc-4006294cfdee</entry>
Aug 09 23:05:25 user nova-compute[72409]:       <entry name="uuid">a074c83c-2e90-4675-89dc-4006294cfdee</entry>
Aug 09 23:05:25 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:05:25 user nova-compute[72409]:     </system>
Aug 09 23:05:25 user nova-compute[72409]:   </sysinfo>
Aug 09 23:05:25 user nova-compute[72409]:   <os>
Aug 09 23:05:25 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:05:25 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:05:25 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:05:25 user nova-compute[72409]:   </os>
Aug 09 23:05:25 user nova-compute[72409]:   <features>
Aug 09 23:05:25 user nova-compute[72409]:     <acpi/>
Aug 09 23:05:25 user nova-compute[72409]:     <apic/>
Aug 09 23:05:25 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:05:25 user nova-compute[72409]:   </features>
Aug 09 23:05:25 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:05:25 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:05:25 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:05:25 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:05:25 user nova-compute[72409]:   </clock>
Aug 09 23:05:25 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:05:25 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:05:25 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:05:25 user nova-compute[72409]:   </cpu>
Aug 09 23:05:25 user nova-compute[72409]:   <devices>
Aug 09 23:05:25 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:05:25 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:05:25 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk"/>
Aug 09 23:05:25 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:05:25 user nova-compute[72409]:     </disk>
Aug 09 23:05:25 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:05:25 user nova-compute[72409]:       <mac address="fa:16:3e:cf:d5:11"/>
Aug 09 23:05:25 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:05:25 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:05:25 user nova-compute[72409]:       <target dev="tap7849914d-f2"/>
Aug 09 23:05:25 user nova-compute[72409]:     </interface>
Aug 09 23:05:25 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:05:25 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/console.log" append="off"/>
Aug 09 23:05:25 user nova-compute[72409]:     </serial>
Aug 09 23:05:25 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:05:25 user nova-compute[72409]:     <video>
Aug 09 23:05:25 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:05:25 user nova-compute[72409]:     </video>
Aug 09 23:05:25 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:05:25 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:05:25 user nova-compute[72409]:     </rng>
Aug 09 23:05:25 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:05:25 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:05:25 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:05:25 user nova-compute[72409]:     </memballoon>
Aug 09 23:05:25 user nova-compute[72409]:   </devices>
Aug 09 23:05:25 user nova-compute[72409]: </domain>
Aug 09 23:05:25 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2016255152',display_name='tempest-ServerRescueNegativeTestJSON-server-2016255152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2016255152',id=37,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d41897ed2b644775a5dcb22d1ecd60a0',ramdisk_id='',reservation_id='r-zlpivyg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-850997564',owner_user_name='tempest-ServerRescueNegativeTestJSON-850997564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:05:22Z,user_data=None,user_id='de2d9f7ad5bb4a93ab61ab100eb1778d',uuid=a074c83c-2e90-4675-89dc-4006294cfdee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converting VIF {"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:d5:11,bridge_name='br-int',has_traffic_filtering=True,id=7849914d-f21b-4fcc-b83c-47dc070987ec,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7849914d-f2') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG os_vif [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:d5:11,bridge_name='br-int',has_traffic_filtering=True,id=7849914d-f21b-4fcc-b83c-47dc070987ec,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7849914d-f2') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7849914d-f2, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7849914d-f2, col_values=(('external_ids', {'iface-id': '7849914d-f21b-4fcc-b83c-47dc070987ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:d5:11', 'vm-uuid': 'a074c83c-2e90-4675-89dc-4006294cfdee'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:25 user nova-compute[72409]: INFO os_vif [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:d5:11,bridge_name='br-int',has_traffic_filtering=True,id=7849914d-f21b-4fcc-b83c-47dc070987ec,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7849914d-f2')
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No VIF found with MAC fa:16:3e:cf:d5:11, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-2342c98f-fa45-4374-bff9-bdd6ad6095e8 req-f69569e0-8355-44f0-86df-8f1ebb881177 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2342c98f-fa45-4374-bff9-bdd6ad6095e8 req-f69569e0-8355-44f0-86df-8f1ebb881177 service nova] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2342c98f-fa45-4374-bff9-bdd6ad6095e8 req-f69569e0-8355-44f0-86df-8f1ebb881177 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2342c98f-fa45-4374-bff9-bdd6ad6095e8 req-f69569e0-8355-44f0-86df-8f1ebb881177 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-2342c98f-fa45-4374-bff9-bdd6ad6095e8 req-f69569e0-8355-44f0-86df-8f1ebb881177 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] No waiting events found dispatching network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:25 user nova-compute[72409]: WARNING nova.compute.manager [req-2342c98f-fa45-4374-bff9-bdd6ad6095e8 req-f69569e0-8355-44f0-86df-8f1ebb881177 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received unexpected event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 for instance with vm_state building and task_state spawning.
Aug 09 23:05:26 user nova-compute[72409]: DEBUG nova.network.neutron [req-5bf60934-2e97-48c0-9bb6-2767ab6e322e req-e4399c03-1e6c-4de1-8f85-82ca71a198e1 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Updated VIF entry in instance network info cache for port 7849914d-f21b-4fcc-b83c-47dc070987ec. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG nova.network.neutron [req-5bf60934-2e97-48c0-9bb6-2767ab6e322e req-e4399c03-1e6c-4de1-8f85-82ca71a198e1 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Updating instance_info_cache with network_info: [{"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5bf60934-2e97-48c0-9bb6-2767ab6e322e req-e4399c03-1e6c-4de1-8f85-82ca71a198e1 service nova] Releasing lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquired lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG nova.network.neutron [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG nova.compute.manager [req-a9309b16-5b9c-4f81-833a-4029f2a6c188 req-4818ed31-c7cb-4a3d-935d-34a9170b6d31 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-changed-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG nova.compute.manager [req-a9309b16-5b9c-4f81-833a-4029f2a6c188 req-4818ed31-c7cb-4a3d-935d-34a9170b6d31 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Refreshing instance network info cache due to event network-changed-f26d04f1-ec38-48a6-840e-cf9d48203a37. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a9309b16-5b9c-4f81-833a-4029f2a6c188 req-4818ed31-c7cb-4a3d-935d-34a9170b6d31 service nova] Acquiring lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updating instance_info_cache with network_info: [{"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Releasing lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:05:27 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Creating image(s)
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Ensure instance console log exists: /opt/stack/data/nova/instances/4301cc62-4ca5-4b2f-bba2-0b3e0631adcf/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Start _get_guest_xml network_info=[{"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxKwgsBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4301cc62-4ca5-4b2f-bba2-0b3e0631adcf', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4fec0e3-71b7-473e-b72a-5f9656c2c15f', 'serial': 'c4fec0e3-71b7-473e-b72a-5f9656c2c15f'}, 'mount_device': '/dev/vda', 'attachment_id': '0f731e95-31f3-475b-8338-683b196e8b0c', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a9309b16-5b9c-4f81-833a-4029f2a6c188 req-4818ed31-c7cb-4a3d-935d-34a9170b6d31 service nova] Acquired lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.network.neutron [req-a9309b16-5b9c-4f81-833a-4029f2a6c188 req-4818ed31-c7cb-4a3d-935d-34a9170b6d31 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Refreshing network info cache for port f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:05:27 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:27 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.objects.instance [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxKwgsBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:05:27 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:05:27 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:05:27 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c40f085-7774-4948-8b4d-7a401baa0cb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:05:27 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b89fa0b-f9ab-48e1-83c6-fa85aff90954]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f] added
Aug 09 23:05:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[184dafa5-51eb-4632-8e18-1b0ee24b65a2]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[af81cf90-4674-4c94-b4cd-b26ea7d3a7a6]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxKwgsBr {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxKwgsBr" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc5a765-266f-46d3-8350-7daadf2efdcc]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yxKwgsBr'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.045s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3b1784-5d7a-499a-86d5-96fff24af701]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.044s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5cd846-c62f-4887-bfe4-55f3f946968d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:05:27 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:05:27 user nova-compute[72409]:  {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:05:27 user nova-compute[72409]: WARNING os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 23:05:27 user nova-compute[72409]: 
Aug 09 23:05:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c571b016-178b-4184-88d4-45929e61dbbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260]
Aug 09 23:05:27 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260] successful.
Aug 09 23:05:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f395a4f-52d3-41dd-8586-4a7de8c5dabb]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73722dc-41f6-4229-92f5-dc00815ae197]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:05:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:05:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f75bb19-dab0-4662-abd3-5c57baddf0f0]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxKwgsBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-4e345d3c-42a4-47e5-bbfa-507def362e2c req-a9c59b2b-b0c5-41ed-afed-79f804db6008 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4e345d3c-42a4-47e5-bbfa-507def362e2c req-a9c59b2b-b0c5-41ed-afed-79f804db6008 service nova] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4e345d3c-42a4-47e5-bbfa-507def362e2c req-a9c59b2b-b0c5-41ed-afed-79f804db6008 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4e345d3c-42a4-47e5-bbfa-507def362e2c req-a9c59b2b-b0c5-41ed-afed-79f804db6008 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-4e345d3c-42a4-47e5-bbfa-507def362e2c req-a9c59b2b-b0c5-41ed-afed-79f804db6008 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] No waiting events found dispatching network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:27 user nova-compute[72409]: WARNING nova.compute.manager [req-4e345d3c-42a4-47e5-bbfa-507def362e2c req-a9c59b2b-b0c5-41ed-afed-79f804db6008 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received unexpected event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 for instance with vm_state building and task_state spawning.
Aug 09 23:05:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-a9309b16-5b9c-4f81-833a-4029f2a6c188 req-4818ed31-c7cb-4a3d-935d-34a9170b6d31 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updated VIF entry in instance network info cache for port f26d04f1-ec38-48a6-840e-cf9d48203a37. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-a9309b16-5b9c-4f81-833a-4029f2a6c188 req-4818ed31-c7cb-4a3d-935d-34a9170b6d31 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updating instance_info_cache with network_info: [{"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a9309b16-5b9c-4f81-833a-4029f2a6c188 req-4818ed31-c7cb-4a3d-935d-34a9170b6d31 service nova] Releasing lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23036633462383638', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036633462383638', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T23:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1632664094',display_name='tempest-TestShelveInstance-server-1632664094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1632664094',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-26576457',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:01:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5ac38a10bc4f46f8acdca4eec503b76f',ramdisk_id='',reservation_id='r-ztardyie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-381502409',owner_user_name='tempest-TestShelveInstance-381502409-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:05:05Z,user_data=None,user_id='6357af30a40c4e9ebae912eabba0bb3e',uuid=4301cc62-4ca5-4b2f-bba2-0b3e0631adcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Converting VIF {"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG nova.objects.instance [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lazy-loading 'pci_devices' on Instance uuid 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:05:28 user nova-compute[72409]:   <uuid>4301cc62-4ca5-4b2f-bba2-0b3e0631adcf</uuid>
Aug 09 23:05:28 user nova-compute[72409]:   <name>instance-0000001e</name>
Aug 09 23:05:28 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:05:28 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:05:28 user nova-compute[72409]:   <metadata>
Aug 09 23:05:28 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:05:28 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:05:28 user nova-compute[72409]:       <nova:name>tempest-TestShelveInstance-server-1632664094</nova:name>
Aug 09 23:05:28 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:05:27</nova:creationTime>
Aug 09 23:05:28 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:05:28 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:05:28 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:05:28 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:05:28 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:05:28 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:05:28 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:05:28 user nova-compute[72409]:       <nova:owner>
Aug 09 23:05:28 user nova-compute[72409]:         <nova:user uuid="6357af30a40c4e9ebae912eabba0bb3e">tempest-TestShelveInstance-381502409-project-member</nova:user>
Aug 09 23:05:28 user nova-compute[72409]:         <nova:project uuid="5ac38a10bc4f46f8acdca4eec503b76f">tempest-TestShelveInstance-381502409</nova:project>
Aug 09 23:05:28 user nova-compute[72409]:       </nova:owner>
Aug 09 23:05:28 user nova-compute[72409]:       <nova:ports>
Aug 09 23:05:28 user nova-compute[72409]:         <nova:port uuid="f26d04f1-ec38-48a6-840e-cf9d48203a37">
Aug 09 23:05:28 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 23:05:28 user nova-compute[72409]:         </nova:port>
Aug 09 23:05:28 user nova-compute[72409]:       </nova:ports>
Aug 09 23:05:28 user nova-compute[72409]:     </nova:instance>
Aug 09 23:05:28 user nova-compute[72409]:   </metadata>
Aug 09 23:05:28 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:05:28 user nova-compute[72409]:     <system>
Aug 09 23:05:28 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:05:28 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:05:28 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:05:28 user nova-compute[72409]:       <entry name="serial">4301cc62-4ca5-4b2f-bba2-0b3e0631adcf</entry>
Aug 09 23:05:28 user nova-compute[72409]:       <entry name="uuid">4301cc62-4ca5-4b2f-bba2-0b3e0631adcf</entry>
Aug 09 23:05:28 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:05:28 user nova-compute[72409]:     </system>
Aug 09 23:05:28 user nova-compute[72409]:   </sysinfo>
Aug 09 23:05:28 user nova-compute[72409]:   <os>
Aug 09 23:05:28 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:05:28 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:05:28 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:05:28 user nova-compute[72409]:   </os>
Aug 09 23:05:28 user nova-compute[72409]:   <features>
Aug 09 23:05:28 user nova-compute[72409]:     <acpi/>
Aug 09 23:05:28 user nova-compute[72409]:     <apic/>
Aug 09 23:05:28 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:05:28 user nova-compute[72409]:   </features>
Aug 09 23:05:28 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:05:28 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:05:28 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:05:28 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:05:28 user nova-compute[72409]:   </clock>
Aug 09 23:05:28 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:05:28 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:05:28 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:05:28 user nova-compute[72409]:   </cpu>
Aug 09 23:05:28 user nova-compute[72409]:   <devices>
Aug 09 23:05:28 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 23:05:28 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:05:28 user nova-compute[72409]:       <source dev="/dev/sdb"/>
Aug 09 23:05:28 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:05:28 user nova-compute[72409]:       <serial>c4fec0e3-71b7-473e-b72a-5f9656c2c15f</serial>
Aug 09 23:05:28 user nova-compute[72409]:     </disk>
Aug 09 23:05:28 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:05:28 user nova-compute[72409]:       <mac address="fa:16:3e:4b:67:e5"/>
Aug 09 23:05:28 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:05:28 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:05:28 user nova-compute[72409]:       <target dev="tapf26d04f1-ec"/>
Aug 09 23:05:28 user nova-compute[72409]:     </interface>
Aug 09 23:05:28 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:05:28 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/4301cc62-4ca5-4b2f-bba2-0b3e0631adcf/console.log" append="off"/>
Aug 09 23:05:28 user nova-compute[72409]:     </serial>
Aug 09 23:05:28 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:05:28 user nova-compute[72409]:     <video>
Aug 09 23:05:28 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:05:28 user nova-compute[72409]:     </video>
Aug 09 23:05:28 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:05:28 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:05:28 user nova-compute[72409]:     </rng>
Aug 09 23:05:28 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:05:28 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:05:28 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:05:28 user nova-compute[72409]:     </memballoon>
Aug 09 23:05:28 user nova-compute[72409]:   </devices>
Aug 09 23:05:28 user nova-compute[72409]: </domain>
Aug 09 23:05:28 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T23:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1632664094',display_name='tempest-TestShelveInstance-server-1632664094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1632664094',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-26576457',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:01:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5ac38a10bc4f46f8acdca4eec503b76f',ramdisk_id='',reservation_id='r-ztardyie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-381502409',owner_user_name='tempest-TestShelveInstance-381502409-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:05:05Z,user_data=None,user_id='6357af30a40c4e9ebae912eabba0bb3e',uuid=4301cc62-4ca5-4b2f-bba2-0b3e0631adcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Converting VIF {"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG os_vif [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf26d04f1-ec, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf26d04f1-ec, col_values=(('external_ids', {'iface-id': 'f26d04f1-ec38-48a6-840e-cf9d48203a37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:67:e5', 'vm-uuid': '4301cc62-4ca5-4b2f-bba2-0b3e0631adcf'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:05:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:28 user nova-compute[72409]: INFO os_vif [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec')
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] No VIF found with MAC fa:16:3e:4b:67:e5, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622329.8216686, 8f7e2151-3d32-4ec8-9903-f5f284879ae0 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:29 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] VM Resumed (Lifecycle Event)
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:05:29 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Instance spawned successfully.
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:29 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622329.8236334, 8f7e2151-3d32-4ec8-9903-f5f284879ae0 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:29 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] VM Started (Lifecycle Event)
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-d9367293-6855-4bf5-8438-279a159e0988 req-ad14fd01-c2f3-4f0e-8c2e-a7ee6abaf682 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received event network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d9367293-6855-4bf5-8438-279a159e0988 req-ad14fd01-c2f3-4f0e-8c2e-a7ee6abaf682 service nova] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d9367293-6855-4bf5-8438-279a159e0988 req-ad14fd01-c2f3-4f0e-8c2e-a7ee6abaf682 service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d9367293-6855-4bf5-8438-279a159e0988 req-ad14fd01-c2f3-4f0e-8c2e-a7ee6abaf682 service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-d9367293-6855-4bf5-8438-279a159e0988 req-ad14fd01-c2f3-4f0e-8c2e-a7ee6abaf682 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] No waiting events found dispatching network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:30 user nova-compute[72409]: WARNING nova.compute.manager [req-d9367293-6855-4bf5-8438-279a159e0988 req-ad14fd01-c2f3-4f0e-8c2e-a7ee6abaf682 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received unexpected event network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec for instance with vm_state building and task_state spawning.
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-d9367293-6855-4bf5-8438-279a159e0988 req-ad14fd01-c2f3-4f0e-8c2e-a7ee6abaf682 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received event network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d9367293-6855-4bf5-8438-279a159e0988 req-ad14fd01-c2f3-4f0e-8c2e-a7ee6abaf682 service nova] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d9367293-6855-4bf5-8438-279a159e0988 req-ad14fd01-c2f3-4f0e-8c2e-a7ee6abaf682 service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d9367293-6855-4bf5-8438-279a159e0988 req-ad14fd01-c2f3-4f0e-8c2e-a7ee6abaf682 service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-d9367293-6855-4bf5-8438-279a159e0988 req-ad14fd01-c2f3-4f0e-8c2e-a7ee6abaf682 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] No waiting events found dispatching network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:30 user nova-compute[72409]: WARNING nova.compute.manager [req-d9367293-6855-4bf5-8438-279a159e0988 req-ad14fd01-c2f3-4f0e-8c2e-a7ee6abaf682 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received unexpected event network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec for instance with vm_state building and task_state spawning.
Aug 09 23:05:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:05:30 user nova-compute[72409]: INFO nova.compute.manager [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Took 9.58 seconds to spawn the instance on the hypervisor.
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:30 user nova-compute[72409]: INFO nova.compute.manager [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Took 11.16 seconds to build instance.
Aug 09 23:05:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1787010a-43ef-4496-b7b1-a558aa037f3f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.289s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622330.5546904, a074c83c-2e90-4675-89dc-4006294cfdee => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] VM Resumed (Lifecycle Event)
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:30 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Instance spawned successfully.
Aug 09 23:05:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:05:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622330.5578945, a074c83c-2e90-4675-89dc-4006294cfdee => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] VM Started (Lifecycle Event)
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:30 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:05:30 user nova-compute[72409]: INFO nova.compute.manager [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Took 8.34 seconds to spawn the instance on the hypervisor.
Aug 09 23:05:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:31 user nova-compute[72409]: INFO nova.compute.manager [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Took 9.86 seconds to build instance.
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c2a4205d-f1cf-482e-96b4-26a05392df23 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "a074c83c-2e90-4675-89dc-4006294cfdee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.039s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPQJTcNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:05:31 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:05:31 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:05:31 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[34927246-5616-4281-8d8f-f8558587d4c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:05:31 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebc376b-da68-44f7-bc1b-7d160ebb6c20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed] added
Aug 09 23:05:31 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c05a6ed-b178-47e3-8879-221545c39232]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6befa12-2827-4149-b1f0-e5655dd4aa9e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yPQJTcNZ {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yPQJTcNZ" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10ce664-cec0-4445-94a8-b7fffce83548]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yPQJTcNZ'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a682f0-4d3d-4347-9043-d93e0d165b6e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc7b61b-5490-4532-8459-e4f3ae24d43a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:05:31 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:05:31 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f276bd8-a9d2-40f3-a1b1-acf20cc8ddc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed, portal: 172.16.0.220,3260]
Aug 09 23:05:31 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed, portal: 172.16.0.220,3260] successful.
Aug 09 23:05:31 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Starting finish_migration {{(pid=72409) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Instance directory exists: not creating {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 23:05:31 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Creating image(s)
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Ensure instance console log exists: /opt/stack/data/nova/instances/b0c67c33-9d1a-4479-a64f-8f867330b9dc/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Start _get_guest_xml network_info=[{"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2069897593-network", "vif_mac": "fa:16:3e:84:8e:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxmNSztl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b0c67c33-9d1a-4479-a64f-8f867330b9dc', 'attached_at': '2023-08-09T23:05:31.000000', 'detached_at': '', 'volume_id': 'cced161b-4fe6-4c99-942c-06f01605ef89', 'serial': 'cced161b-4fe6-4c99-942c-06f01605ef89'}, 'mount_device': '/dev/vda', 'attachment_id': '22852c24-80e1-4722-b1cb-d4c99315ea73', 'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cf9ee7-3396-468d-8272-5518703b2718]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:31 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:31 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:46:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.objects.instance [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'vcpu_model' on Instance uuid b0c67c33-9d1a-4479-a64f-8f867330b9dc {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[723d4847-2509-44e0-b5a1-997416f40aff]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:05:31 user nova-compute[72409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:05:31 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:05:31 user nova-compute[72409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:05:31 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxmNSztl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:05:31 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.064s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2982d468-fb82-405f-b1b3-9cb3cb9a6835]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:05:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPQJTcNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-3db4ff18-3519-4c74-a4dc-528fbe46cc63 req-1ff729fe-a560-4794-bff8-ec595c88d78a service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3db4ff18-3519-4c74-a4dc-528fbe46cc63 req-1ff729fe-a560-4794-bff8-ec595c88d78a service nova] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3db4ff18-3519-4c74-a4dc-528fbe46cc63 req-1ff729fe-a560-4794-bff8-ec595c88d78a service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3db4ff18-3519-4c74-a4dc-528fbe46cc63 req-1ff729fe-a560-4794-bff8-ec595c88d78a service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-3db4ff18-3519-4c74-a4dc-528fbe46cc63 req-1ff729fe-a560-4794-bff8-ec595c88d78a service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] No waiting events found dispatching network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:32 user nova-compute[72409]: WARNING nova.compute.manager [req-3db4ff18-3519-4c74-a4dc-528fbe46cc63 req-1ff729fe-a560-4794-bff8-ec595c88d78a service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received unexpected event network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 23:05:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-3db4ff18-3519-4c74-a4dc-528fbe46cc63 req-1ff729fe-a560-4794-bff8-ec595c88d78a service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3db4ff18-3519-4c74-a4dc-528fbe46cc63 req-1ff729fe-a560-4794-bff8-ec595c88d78a service nova] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3db4ff18-3519-4c74-a4dc-528fbe46cc63 req-1ff729fe-a560-4794-bff8-ec595c88d78a service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3db4ff18-3519-4c74-a4dc-528fbe46cc63 req-1ff729fe-a560-4794-bff8-ec595c88d78a service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-3db4ff18-3519-4c74-a4dc-528fbe46cc63 req-1ff729fe-a560-4794-bff8-ec595c88d78a service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] No waiting events found dispatching network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:32 user nova-compute[72409]: WARNING nova.compute.manager [req-3db4ff18-3519-4c74-a4dc-528fbe46cc63 req-1ff729fe-a560-4794-bff8-ec595c88d78a service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received unexpected event network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 23:05:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.521s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] <== connect_volume: return (1522ms) {'type': 'block', 'scsi_wwn': '26432636632323338', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432636632323338', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.015s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:05:32 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:05:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:05:32 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'flavor' on Instance uuid c0f72ca0-06ef-444d-97d4-fca49bdde831 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[77db86f9-85b2-43c8-aad3-97bb93dc09ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:05:32 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[781e3bfe-4b52-45d8-90e1-3616afe4945d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89] added
Aug 09 23:05:32 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:05:32 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:05:32 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:05:32 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:05:32 user nova-compute[72409]:   <serial>a12b857d-36ba-4bb9-8d0f-6e71f640daed</serial>
Aug 09 23:05:32 user nova-compute[72409]: </disk>
Aug 09 23:05:32 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[56583c2b-160a-4dae-b54a-28979b59a402]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a056e2-ba6c-4b15-a3cc-0c0fff69a77e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxmNSztl {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxmNSztl" returned: 0 in 0.031s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[920de431-302a-4eb9-ad39-7bce87c9156d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DxmNSztl'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42123f7-1457-4071-ac90-640321c20372]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8226042a-7d99-4165-8297-d4602f7129fd]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:05:33 user nova-compute[72409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:05:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:05:33 user nova-compute[72409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:05:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[23141865-570a-4139-8b3c-9acfa8f58f01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260]
Aug 09 23:05:33 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260] successful.
Aug 09 23:05:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9559c187-3ba1-4f5c-97fc-fd31af30ee43]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[133097f5-84f8-4ac9-9213-2c8b66dc3c1e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:05:33 user nova-compute[72409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:05:33 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:05:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:05:33 user nova-compute[72409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:05:33 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:05:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2624def4-ce81-4a19-8e22-275a9a7999c8]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxmNSztl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622318.3985186, f6761b27-e1f3-4f6e-a7e7-990910a3523b => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:33 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] VM Stopped (Lifecycle Event)
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ab987317-882a-4e3d-8841-9227661eb967 None None] [instance: f6761b27-e1f3-4f6e-a7e7-990910a3523b] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] No VIF found with MAC fa:16:3e:03:7b:bf, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622333.5487845, 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] VM Resumed (Lifecycle Event)
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:05:33 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Instance spawned successfully.
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622333.553345, 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] VM Started (Lifecycle Event)
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-98657546-f30b-41c0-a254-fbacaae78bac tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.347s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8e0d3545-3193-448a-9731-b89dac9c784c tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.392s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== connect_volume: return (2443ms) {'type': 'block', 'scsi_wwn': '23435333564613265', 'path': '/dev/sdd'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435333564613265', 'path': '/dev/sdd'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1886528577',display_name='tempest-ServerActionsTestOtherA-server-1886528577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1886528577',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzHC0syLklL8GtXvz6DwLHZAI3KijCzzG+c3H7vbfCfvBbdLu31zQrL5KQv6qO6LPapTOC2Zi0KeYbsTlIE+6d9oW1MPV8oBMrDCQEY9sL1aQ71vDiQHBGpACA1bJ0plQ==',key_name='tempest-keypair-183406528',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c7e3f592e7141659581ae7f67c6af43',ramdisk_id='',reservation_id='r-w5z89s1i',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-640999933',owner_user_name='tempest-ServerActionsTestOtherA-640999933-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd76f1c0d9b42269fcc69f24c9f59e6',uuid=b0c67c33-9d1a-4479-a64f-8f867330b9dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2069897593-network", "vif_mac": "fa:16:3e:84:8e:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converting VIF {"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2069897593-network", "vif_mac": "fa:16:3e:84:8e:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:05:34 user nova-compute[72409]:   <uuid>b0c67c33-9d1a-4479-a64f-8f867330b9dc</uuid>
Aug 09 23:05:34 user nova-compute[72409]:   <name>instance-00000020</name>
Aug 09 23:05:34 user nova-compute[72409]:   <memory>2097152</memory>
Aug 09 23:05:34 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:05:34 user nova-compute[72409]:   <metadata>
Aug 09 23:05:34 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:05:34 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:05:34 user nova-compute[72409]:       <nova:name>tempest-ServerActionsTestOtherA-server-1886528577</nova:name>
Aug 09 23:05:34 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:05:31</nova:creationTime>
Aug 09 23:05:34 user nova-compute[72409]:       <nova:flavor name="m1.small">
Aug 09 23:05:34 user nova-compute[72409]:         <nova:memory>2048</nova:memory>
Aug 09 23:05:34 user nova-compute[72409]:         <nova:disk>20</nova:disk>
Aug 09 23:05:34 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:05:34 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:05:34 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:05:34 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:05:34 user nova-compute[72409]:       <nova:owner>
Aug 09 23:05:34 user nova-compute[72409]:         <nova:user uuid="efd76f1c0d9b42269fcc69f24c9f59e6">tempest-ServerActionsTestOtherA-640999933-project-member</nova:user>
Aug 09 23:05:34 user nova-compute[72409]:         <nova:project uuid="8c7e3f592e7141659581ae7f67c6af43">tempest-ServerActionsTestOtherA-640999933</nova:project>
Aug 09 23:05:34 user nova-compute[72409]:       </nova:owner>
Aug 09 23:05:34 user nova-compute[72409]:       <nova:ports>
Aug 09 23:05:34 user nova-compute[72409]:         <nova:port uuid="b699c9c4-31f5-41b2-ac73-16353dceb256">
Aug 09 23:05:34 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 23:05:34 user nova-compute[72409]:         </nova:port>
Aug 09 23:05:34 user nova-compute[72409]:       </nova:ports>
Aug 09 23:05:34 user nova-compute[72409]:     </nova:instance>
Aug 09 23:05:34 user nova-compute[72409]:   </metadata>
Aug 09 23:05:34 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:05:34 user nova-compute[72409]:     <system>
Aug 09 23:05:34 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:05:34 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:05:34 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:05:34 user nova-compute[72409]:       <entry name="serial">b0c67c33-9d1a-4479-a64f-8f867330b9dc</entry>
Aug 09 23:05:34 user nova-compute[72409]:       <entry name="uuid">b0c67c33-9d1a-4479-a64f-8f867330b9dc</entry>
Aug 09 23:05:34 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:05:34 user nova-compute[72409]:     </system>
Aug 09 23:05:34 user nova-compute[72409]:   </sysinfo>
Aug 09 23:05:34 user nova-compute[72409]:   <os>
Aug 09 23:05:34 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:05:34 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:05:34 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:05:34 user nova-compute[72409]:   </os>
Aug 09 23:05:34 user nova-compute[72409]:   <features>
Aug 09 23:05:34 user nova-compute[72409]:     <acpi/>
Aug 09 23:05:34 user nova-compute[72409]:     <apic/>
Aug 09 23:05:34 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:05:34 user nova-compute[72409]:   </features>
Aug 09 23:05:34 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:05:34 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:05:34 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:05:34 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:05:34 user nova-compute[72409]:   </clock>
Aug 09 23:05:34 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:05:34 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:05:34 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:05:34 user nova-compute[72409]:   </cpu>
Aug 09 23:05:34 user nova-compute[72409]:   <devices>
Aug 09 23:05:34 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 23:05:34 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:05:34 user nova-compute[72409]:       <source dev="/dev/sdd"/>
Aug 09 23:05:34 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:05:34 user nova-compute[72409]:       <serial>cced161b-4fe6-4c99-942c-06f01605ef89</serial>
Aug 09 23:05:34 user nova-compute[72409]:     </disk>
Aug 09 23:05:34 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:05:34 user nova-compute[72409]:       <mac address="fa:16:3e:84:8e:ae"/>
Aug 09 23:05:34 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:05:34 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:05:34 user nova-compute[72409]:       <target dev="tapb699c9c4-31"/>
Aug 09 23:05:34 user nova-compute[72409]:     </interface>
Aug 09 23:05:34 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:05:34 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/b0c67c33-9d1a-4479-a64f-8f867330b9dc/console.log" append="off"/>
Aug 09 23:05:34 user nova-compute[72409]:     </serial>
Aug 09 23:05:34 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:05:34 user nova-compute[72409]:     <video>
Aug 09 23:05:34 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:05:34 user nova-compute[72409]:     </video>
Aug 09 23:05:34 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:05:34 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:05:34 user nova-compute[72409]:     </rng>
Aug 09 23:05:34 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:05:34 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:05:34 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:05:34 user nova-compute[72409]:     </memballoon>
Aug 09 23:05:34 user nova-compute[72409]:   </devices>
Aug 09 23:05:34 user nova-compute[72409]: </domain>
Aug 09 23:05:34 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1886528577',display_name='tempest-ServerActionsTestOtherA-server-1886528577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1886528577',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzHC0syLklL8GtXvz6DwLHZAI3KijCzzG+c3H7vbfCfvBbdLu31zQrL5KQv6qO6LPapTOC2Zi0KeYbsTlIE+6d9oW1MPV8oBMrDCQEY9sL1aQ71vDiQHBGpACA1bJ0plQ==',key_name='tempest-keypair-183406528',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c7e3f592e7141659581ae7f67c6af43',ramdisk_id='',reservation_id='r-w5z89s1i',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-640999933',owner_user_name='tempest-ServerActionsTestOtherA-640999933-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd76f1c0d9b42269fcc69f24c9f59e6',uuid=b0c67c33-9d1a-4479-a64f-8f867330b9dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2069897593-network", "vif_mac": "fa:16:3e:84:8e:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converting VIF {"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2069897593-network", "vif_mac": "fa:16:3e:84:8e:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG os_vif [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb699c9c4-31, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb699c9c4-31, col_values=(('external_ids', {'iface-id': 'b699c9c4-31f5-41b2-ac73-16353dceb256', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:8e:ae', 'vm-uuid': 'b0c67c33-9d1a-4479-a64f-8f867330b9dc'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:34 user nova-compute[72409]: INFO os_vif [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31')
Aug 09 23:05:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:05:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] No VIF found with MAC fa:16:3e:84:8e:ae, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:05:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-3ce8e381-275b-48fb-b25f-902010d44714 req-04f557a6-f397-48f7-b5b2-a46a0acfb0c7 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received event network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3ce8e381-275b-48fb-b25f-902010d44714 req-04f557a6-f397-48f7-b5b2-a46a0acfb0c7 service nova] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3ce8e381-275b-48fb-b25f-902010d44714 req-04f557a6-f397-48f7-b5b2-a46a0acfb0c7 service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3ce8e381-275b-48fb-b25f-902010d44714 req-04f557a6-f397-48f7-b5b2-a46a0acfb0c7 service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-3ce8e381-275b-48fb-b25f-902010d44714 req-04f557a6-f397-48f7-b5b2-a46a0acfb0c7 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] No waiting events found dispatching network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:37 user nova-compute[72409]: WARNING nova.compute.manager [req-3ce8e381-275b-48fb-b25f-902010d44714 req-04f557a6-f397-48f7-b5b2-a46a0acfb0c7 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received unexpected event network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 for instance with vm_state active and task_state resize_finish.
Aug 09 23:05:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-09fc1e65-b71c-4595-b534-05f3e5641aeb req-48c3580c-db92-48c5-91f1-f0cdc69a5ebd service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-changed-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-09fc1e65-b71c-4595-b534-05f3e5641aeb req-48c3580c-db92-48c5-91f1-f0cdc69a5ebd service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Refreshing instance network info cache due to event network-changed-72040fc9-f3df-43df-a3e4-c5ba8c410187. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:05:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-09fc1e65-b71c-4595-b534-05f3e5641aeb req-48c3580c-db92-48c5-91f1-f0cdc69a5ebd service nova] Acquiring lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-09fc1e65-b71c-4595-b534-05f3e5641aeb req-48c3580c-db92-48c5-91f1-f0cdc69a5ebd service nova] Acquired lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:37 user nova-compute[72409]: DEBUG nova.network.neutron [req-09fc1e65-b71c-4595-b534-05f3e5641aeb req-48c3580c-db92-48c5-91f1-f0cdc69a5ebd service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Refreshing network info cache for port 72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:05:38 user nova-compute[72409]: DEBUG nova.network.neutron [req-09fc1e65-b71c-4595-b534-05f3e5641aeb req-48c3580c-db92-48c5-91f1-f0cdc69a5ebd service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updated VIF entry in instance network info cache for port 72040fc9-f3df-43df-a3e4-c5ba8c410187. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:05:38 user nova-compute[72409]: DEBUG nova.network.neutron [req-09fc1e65-b71c-4595-b534-05f3e5641aeb req-48c3580c-db92-48c5-91f1-f0cdc69a5ebd service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updating instance_info_cache with network_info: [{"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-09fc1e65-b71c-4595-b534-05f3e5641aeb req-48c3580c-db92-48c5-91f1-f0cdc69a5ebd service nova] Releasing lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:39 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622339.100645, b0c67c33-9d1a-4479-a64f-8f867330b9dc => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:39 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] VM Resumed (Lifecycle Event)
Aug 09 23:05:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:05:39 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Instance running successfully.
Aug 09 23:05:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Failed to set time: agent not configured {{(pid=72409) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 23:05:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-da8da211-e815-4ec4-89f3-f7f23361d2fb tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] finish_migration finished successfully. {{(pid=72409) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 23:05:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:39 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 23:05:39 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622339.1017199, b0c67c33-9d1a-4479-a64f-8f867330b9dc => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:39 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] VM Started (Lifecycle Event)
Aug 09 23:05:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:39 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 23:05:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-4e66b427-1b01-4ca0-95cf-327c4e035c1a req-c26d88ea-9052-4d65-87aa-3b613f0ef31c service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received event network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4e66b427-1b01-4ca0-95cf-327c4e035c1a req-c26d88ea-9052-4d65-87aa-3b613f0ef31c service nova] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4e66b427-1b01-4ca0-95cf-327c4e035c1a req-c26d88ea-9052-4d65-87aa-3b613f0ef31c service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4e66b427-1b01-4ca0-95cf-327c4e035c1a req-c26d88ea-9052-4d65-87aa-3b613f0ef31c service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-4e66b427-1b01-4ca0-95cf-327c4e035c1a req-c26d88ea-9052-4d65-87aa-3b613f0ef31c service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] No waiting events found dispatching network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:39 user nova-compute[72409]: WARNING nova.compute.manager [req-4e66b427-1b01-4ca0-95cf-327c4e035c1a req-c26d88ea-9052-4d65-87aa-3b613f0ef31c service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received unexpected event network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 for instance with vm_state active and task_state resize_finish.
Aug 09 23:05:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:40 user nova-compute[72409]: DEBUG nova.compute.manager [req-6f43eb13-b19c-4a6a-911c-c91bfe7e69b7 req-456ae018-9eac-4341-8166-5ccd8701d83a service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-changed-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:40 user nova-compute[72409]: DEBUG nova.compute.manager [req-6f43eb13-b19c-4a6a-911c-c91bfe7e69b7 req-456ae018-9eac-4341-8166-5ccd8701d83a service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Refreshing instance network info cache due to event network-changed-72040fc9-f3df-43df-a3e4-c5ba8c410187. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:05:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6f43eb13-b19c-4a6a-911c-c91bfe7e69b7 req-456ae018-9eac-4341-8166-5ccd8701d83a service nova] Acquiring lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6f43eb13-b19c-4a6a-911c-c91bfe7e69b7 req-456ae018-9eac-4341-8166-5ccd8701d83a service nova] Acquired lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:40 user nova-compute[72409]: DEBUG nova.network.neutron [req-6f43eb13-b19c-4a6a-911c-c91bfe7e69b7 req-456ae018-9eac-4341-8166-5ccd8701d83a service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Refreshing network info cache for port 72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:05:40 user nova-compute[72409]: DEBUG nova.network.neutron [req-6f43eb13-b19c-4a6a-911c-c91bfe7e69b7 req-456ae018-9eac-4341-8166-5ccd8701d83a service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updated VIF entry in instance network info cache for port 72040fc9-f3df-43df-a3e4-c5ba8c410187. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:05:40 user nova-compute[72409]: DEBUG nova.network.neutron [req-6f43eb13-b19c-4a6a-911c-c91bfe7e69b7 req-456ae018-9eac-4341-8166-5ccd8701d83a service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updating instance_info_cache with network_info: [{"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6f43eb13-b19c-4a6a-911c-c91bfe7e69b7 req-456ae018-9eac-4341-8166-5ccd8701d83a service nova] Releasing lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:40 user nova-compute[72409]: INFO nova.compute.manager [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Rebooting instance
Aug 09 23:05:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquired lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:40 user nova-compute[72409]: DEBUG nova.network.neutron [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:05:41 user nova-compute[72409]: DEBUG nova.network.neutron [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updating instance_info_cache with network_info: [{"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:05:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Releasing lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:05:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-bc9462f3-7085-4ac6-a2ec-4648c759262f req-24b3ae6f-0160-4a99-b6a7-c5ee7d509200 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-vif-unplugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bc9462f3-7085-4ac6-a2ec-4648c759262f req-24b3ae6f-0160-4a99-b6a7-c5ee7d509200 service nova] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bc9462f3-7085-4ac6-a2ec-4648c759262f req-24b3ae6f-0160-4a99-b6a7-c5ee7d509200 service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bc9462f3-7085-4ac6-a2ec-4648c759262f req-24b3ae6f-0160-4a99-b6a7-c5ee7d509200 service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-bc9462f3-7085-4ac6-a2ec-4648c759262f req-24b3ae6f-0160-4a99-b6a7-c5ee7d509200 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] No waiting events found dispatching network-vif-unplugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:44 user nova-compute[72409]: WARNING nova.compute.manager [req-bc9462f3-7085-4ac6-a2ec-4648c759262f req-24b3ae6f-0160-4a99-b6a7-c5ee7d509200 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received unexpected event network-vif-unplugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 for instance with vm_state active and task_state reboot_started.
Aug 09 23:05:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Instance shutdown successfully.
Aug 09 23:05:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-82d0162d-60f3-4162-9d46-a2d44ed73a14 req-b2dbbb60-f8c0-49fe-ae39-81c93595394d service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-82d0162d-60f3-4162-9d46-a2d44ed73a14 req-b2dbbb60-f8c0-49fe-ae39-81c93595394d service nova] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-82d0162d-60f3-4162-9d46-a2d44ed73a14 req-b2dbbb60-f8c0-49fe-ae39-81c93595394d service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-82d0162d-60f3-4162-9d46-a2d44ed73a14 req-b2dbbb60-f8c0-49fe-ae39-81c93595394d service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-82d0162d-60f3-4162-9d46-a2d44ed73a14 req-b2dbbb60-f8c0-49fe-ae39-81c93595394d service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] No waiting events found dispatching network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:46 user nova-compute[72409]: WARNING nova.compute.manager [req-82d0162d-60f3-4162-9d46-a2d44ed73a14 req-b2dbbb60-f8c0-49fe-ae39-81c93595394d service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received unexpected event network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 for instance with vm_state active and task_state reboot_started.
Aug 09 23:05:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:48 user nova-compute[72409]: DEBUG nova.compute.manager [req-1a18319b-388c-4633-ba9b-58f72917d85c req-7aa8488a-94b1-4f4d-880d-df11fb43cb25 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1a18319b-388c-4633-ba9b-58f72917d85c req-7aa8488a-94b1-4f4d-880d-df11fb43cb25 service nova] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1a18319b-388c-4633-ba9b-58f72917d85c req-7aa8488a-94b1-4f4d-880d-df11fb43cb25 service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1a18319b-388c-4633-ba9b-58f72917d85c req-7aa8488a-94b1-4f4d-880d-df11fb43cb25 service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:48 user nova-compute[72409]: DEBUG nova.compute.manager [req-1a18319b-388c-4633-ba9b-58f72917d85c req-7aa8488a-94b1-4f4d-880d-df11fb43cb25 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] No waiting events found dispatching network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:48 user nova-compute[72409]: WARNING nova.compute.manager [req-1a18319b-388c-4633-ba9b-58f72917d85c req-7aa8488a-94b1-4f4d-880d-df11fb43cb25 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received unexpected event network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 for instance with vm_state active and task_state reboot_started.
Aug 09 23:05:48 user nova-compute[72409]: DEBUG nova.compute.manager [req-1a18319b-388c-4633-ba9b-58f72917d85c req-7aa8488a-94b1-4f4d-880d-df11fb43cb25 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1a18319b-388c-4633-ba9b-58f72917d85c req-7aa8488a-94b1-4f4d-880d-df11fb43cb25 service nova] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1a18319b-388c-4633-ba9b-58f72917d85c req-7aa8488a-94b1-4f4d-880d-df11fb43cb25 service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1a18319b-388c-4633-ba9b-58f72917d85c req-7aa8488a-94b1-4f4d-880d-df11fb43cb25 service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:48 user nova-compute[72409]: DEBUG nova.compute.manager [req-1a18319b-388c-4633-ba9b-58f72917d85c req-7aa8488a-94b1-4f4d-880d-df11fb43cb25 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] No waiting events found dispatching network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:05:48 user nova-compute[72409]: WARNING nova.compute.manager [req-1a18319b-388c-4633-ba9b-58f72917d85c req-7aa8488a-94b1-4f4d-880d-df11fb43cb25 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received unexpected event network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 for instance with vm_state active and task_state reboot_started.
Aug 09 23:05:49 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Removed pending event for c0f72ca0-06ef-444d-97d4-fca49bdde831 due to event {{(pid=72409) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 23:05:49 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622349.1837435, c0f72ca0-06ef-444d-97d4-fca49bdde831 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:49 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] VM Resumed (Lifecycle Event)
Aug 09 23:05:49 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Instance running successfully.
Aug 09 23:05:49 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Instance soft rebooted successfully.
Aug 09 23:05:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:49 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 09 23:05:49 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622349.1851845, c0f72ca0-06ef-444d-97d4-fca49bdde831 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:05:49 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] VM Started (Lifecycle Event)
Aug 09 23:05:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:05:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-76ed4ac3-d250-4886-9240-7941a0bc807b tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.486s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:05:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "438a2af8-be2a-48cb-af65-7ad4e1259c56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:56 user nova-compute[72409]: DEBUG nova.compute.manager [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:05:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:05:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:05:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:05:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:05:56 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:05:56 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 23:05:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:56 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:05:56 user nova-compute[72409]: INFO nova.compute.claims [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Claim successful on node user
Aug 09 23:05:56 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] There are 0 instances to clean {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG nova.network.neutron [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:05:57 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:05:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:05:57 user nova-compute[72409]: INFO nova.virt.block_device [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Booting with volume 4ad73b76-b30a-4219-ac4c-7c96747e462a at /dev/vda
Aug 09 23:05:57 user nova-compute[72409]: DEBUG nova.policy [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd5e2f13e0a448e836dd8684b889a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d29522bd16460eb1edc9fb7918111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG os_brick.utils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c431e4-c07a-484f-9016-03998ad67b5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5b7765-1c57-4329-a32f-14fbc13101b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb51cf5-7202-4fdf-bc92-74ae82e92bfd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5999464e-612a-4b93-8923-6ab02ad705ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:05:57 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:05:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c566bd53-3a12-4f40-9060-a7aec243bba7]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG os_brick.utils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:05:57 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Updating existing volume attachment record: 068c3405-468d-43df-8a6b-c5f5386a88f2 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:05:58 user nova-compute[72409]: DEBUG nova.network.neutron [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Successfully created port: 39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:05:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:05:59 user nova-compute[72409]: DEBUG nova.network.neutron [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Successfully updated port: 39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:05:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "refresh_cache-438a2af8-be2a-48cb-af65-7ad4e1259c56" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquired lock "refresh_cache-438a2af8-be2a-48cb-af65-7ad4e1259c56" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:05:59 user nova-compute[72409]: DEBUG nova.network.neutron [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:05:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-66417fee-6f57-479f-9b9a-1e577209f8c3 req-8e659fe8-b088-49d1-806c-2a74229bcc97 service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Received event network-changed-39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:05:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-66417fee-6f57-479f-9b9a-1e577209f8c3 req-8e659fe8-b088-49d1-806c-2a74229bcc97 service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Refreshing instance network info cache due to event network-changed-39a8aeb7-1217-485f-b885-82bed5f3b3ef. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:05:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-66417fee-6f57-479f-9b9a-1e577209f8c3 req-8e659fe8-b088-49d1-806c-2a74229bcc97 service nova] Acquiring lock "refresh_cache-438a2af8-be2a-48cb-af65-7ad4e1259c56" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:05:59 user nova-compute[72409]: DEBUG nova.network.neutron [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG nova.network.neutron [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Updating instance_info_cache with network_info: [{"id": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "address": "fa:16:3e:f1:17:d5", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a8aeb7-12", "ovs_interfaceid": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Releasing lock "refresh_cache-438a2af8-be2a-48cb-af65-7ad4e1259c56" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG nova.compute.manager [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Instance network_info: |[{"id": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "address": "fa:16:3e:f1:17:d5", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a8aeb7-12", "ovs_interfaceid": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-66417fee-6f57-479f-9b9a-1e577209f8c3 req-8e659fe8-b088-49d1-806c-2a74229bcc97 service nova] Acquired lock "refresh_cache-438a2af8-be2a-48cb-af65-7ad4e1259c56" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG nova.network.neutron [req-66417fee-6f57-479f-9b9a-1e577209f8c3 req-8e659fe8-b088-49d1-806c-2a74229bcc97 service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Refreshing network info cache for port 39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG nova.network.neutron [req-66417fee-6f57-479f-9b9a-1e577209f8c3 req-8e659fe8-b088-49d1-806c-2a74229bcc97 service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Updated VIF entry in instance network info cache for port 39a8aeb7-1217-485f-b885-82bed5f3b3ef. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG nova.network.neutron [req-66417fee-6f57-479f-9b9a-1e577209f8c3 req-8e659fe8-b088-49d1-806c-2a74229bcc97 service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Updating instance_info_cache with network_info: [{"id": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "address": "fa:16:3e:f1:17:d5", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a8aeb7-12", "ovs_interfaceid": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-66417fee-6f57-479f-9b9a-1e577209f8c3 req-8e659fe8-b088-49d1-806c-2a74229bcc97 service nova] Releasing lock "refresh_cache-438a2af8-be2a-48cb-af65-7ad4e1259c56" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:00 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:01 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:06:03 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:06:03 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7194MB free_disk=25.344768524169922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Applying migration context for instance b0c67c33-9d1a-4479-a64f-8f867330b9dc as it has an incoming, in-progress migration a255be55-f015-48b8-a5b2-4189b8075782. Migration status is finished {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 23:06:03 user nova-compute[72409]: INFO nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updating resource usage from migration a255be55-f015-48b8-a5b2-4189b8075782
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c0f72ca0-06ef-444d-97d4-fca49bdde831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Migration a255be55-f015-48b8-a5b2-4189b8075782 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance b0c67c33-9d1a-4479-a64f-8f867330b9dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance fbee7df5-5051-4064-bfa3-fa7a0da9c7aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a75a5458-8710-425d-9755-dc2dc71f7d5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 438a2af8-be2a-48cb-af65-7ad4e1259c56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing inventories for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating ProviderTree inventory for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 23:06:03 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing aggregate associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, aggregates: None {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 23:06:04 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing trait associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 23:06:04 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:06:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:04 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:06:04 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:06:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.859s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:06:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:06:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:06:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:06:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:06:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:06:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:06:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:06:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:06:06 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:06:06 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updating instance_info_cache with network_info: [{"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:06:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:06:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:06:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.compute.manager [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:06:07 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Creating image(s)
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Ensure instance console log exists: /opt/stack/data/nova/instances/438a2af8-be2a-48cb-af65-7ad4e1259c56/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Start _get_guest_xml network_info=[{"id": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "address": "fa:16:3e:f1:17:d5", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a8aeb7-12", "ovs_interfaceid": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQBwOVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '438a2af8-be2a-48cb-af65-7ad4e1259c56', 'attached_at': '', 'detached_at': '', 'volume_id': '4ad73b76-b30a-4219-ac4c-7c96747e462a', 'serial': '4ad73b76-b30a-4219-ac4c-7c96747e462a'}, 'mount_device': '/dev/vda', 'attachment_id': '068c3405-468d-43df-8a6b-c5f5386a88f2', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:06:07 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:06:07 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQBwOVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:06:07 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:06:07 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:06:07 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa49ec9-27b4-436b-99dc-4479b1ad35b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:06:07 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0616c8-e21a-4dc0-8721-5da1794ea99c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a] added
Aug 09 23:06:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11adba7-b6fe-49c9-a175-458da988452d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dbff18-0777-42dd-aa2b-ee166f45e2fe]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQBwOVRZ {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQBwOVRZ" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0caa6c1-ce01-4804-9f53-95910bb1a86f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WQBwOVRZ'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0c90a4-a148-4352-a9dd-941ed561adbf]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f64b54-7134-440a-88f0-29c238b4ed71]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:06:07 user nova-compute[72409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:06:07 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:06:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:06:07 user nova-compute[72409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:06:07 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:06:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[004147d4-542d-49dc-a2d2-6e048805ee0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260]
Aug 09 23:06:07 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260] successful.
Aug 09 23:06:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb3d4b9-b778-4d98-add1-886e9603e8bb]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:06:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[400e6748-2e4d-493a-9956-c9e4e2cbd887]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:06:08 user nova-compute[72409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:06:08 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:06:08 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:06:08 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:06:08 user nova-compute[72409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:06:08 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:06:08 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:06:08 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadad104-0926-4d1e-9e24-b849042c6be2]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:06:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQBwOVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23666646434613365', 'path': '/dev/sde'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666646434613365', 'path': '/dev/sde'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1576433463',display_name='tempest-TestVolumeBootPattern-server-1576433463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1576433463',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1aHN+hYxllL5tuB8HvAlIacEjfYF+w1msAbdktrPPHCcF11JPXwNiBeUP+wL/G+SHuINuvHbsNfaNGa+fgVIlRHvAF1ETChrpZfHrOyvh53hIFQ9t/gmToggpOGTMoMw==',key_name='tempest-TestVolumeBootPattern-982211312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-292uo6yh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:05:58Z,user_data=None,user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=438a2af8-be2a-48cb-af65-7ad4e1259c56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "address": "fa:16:3e:f1:17:d5", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a8aeb7-12", "ovs_interfaceid": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "address": "fa:16:3e:f1:17:d5", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a8aeb7-12", "ovs_interfaceid": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:17:d5,bridge_name='br-int',has_traffic_filtering=True,id=39a8aeb7-1217-485f-b885-82bed5f3b3ef,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a8aeb7-12') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG nova.objects.instance [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lazy-loading 'pci_devices' on Instance uuid 438a2af8-be2a-48cb-af65-7ad4e1259c56 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:06:09 user nova-compute[72409]:   <uuid>438a2af8-be2a-48cb-af65-7ad4e1259c56</uuid>
Aug 09 23:06:09 user nova-compute[72409]:   <name>instance-00000026</name>
Aug 09 23:06:09 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:06:09 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:06:09 user nova-compute[72409]:   <metadata>
Aug 09 23:06:09 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:06:09 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:06:09 user nova-compute[72409]:       <nova:name>tempest-TestVolumeBootPattern-server-1576433463</nova:name>
Aug 09 23:06:09 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:06:07</nova:creationTime>
Aug 09 23:06:09 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:06:09 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:06:09 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:06:09 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:06:09 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:06:09 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:06:09 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:06:09 user nova-compute[72409]:       <nova:owner>
Aug 09 23:06:09 user nova-compute[72409]:         <nova:user uuid="bcd5e2f13e0a448e836dd8684b889a70">tempest-TestVolumeBootPattern-431608932-project-member</nova:user>
Aug 09 23:06:09 user nova-compute[72409]:         <nova:project uuid="b6d29522bd16460eb1edc9fb7918111f">tempest-TestVolumeBootPattern-431608932</nova:project>
Aug 09 23:06:09 user nova-compute[72409]:       </nova:owner>
Aug 09 23:06:09 user nova-compute[72409]:       <nova:ports>
Aug 09 23:06:09 user nova-compute[72409]:         <nova:port uuid="39a8aeb7-1217-485f-b885-82bed5f3b3ef">
Aug 09 23:06:09 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 23:06:09 user nova-compute[72409]:         </nova:port>
Aug 09 23:06:09 user nova-compute[72409]:       </nova:ports>
Aug 09 23:06:09 user nova-compute[72409]:     </nova:instance>
Aug 09 23:06:09 user nova-compute[72409]:   </metadata>
Aug 09 23:06:09 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:06:09 user nova-compute[72409]:     <system>
Aug 09 23:06:09 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:06:09 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:06:09 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:06:09 user nova-compute[72409]:       <entry name="serial">438a2af8-be2a-48cb-af65-7ad4e1259c56</entry>
Aug 09 23:06:09 user nova-compute[72409]:       <entry name="uuid">438a2af8-be2a-48cb-af65-7ad4e1259c56</entry>
Aug 09 23:06:09 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:06:09 user nova-compute[72409]:     </system>
Aug 09 23:06:09 user nova-compute[72409]:   </sysinfo>
Aug 09 23:06:09 user nova-compute[72409]:   <os>
Aug 09 23:06:09 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:06:09 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:06:09 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:06:09 user nova-compute[72409]:   </os>
Aug 09 23:06:09 user nova-compute[72409]:   <features>
Aug 09 23:06:09 user nova-compute[72409]:     <acpi/>
Aug 09 23:06:09 user nova-compute[72409]:     <apic/>
Aug 09 23:06:09 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:06:09 user nova-compute[72409]:   </features>
Aug 09 23:06:09 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:06:09 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:06:09 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:06:09 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:06:09 user nova-compute[72409]:   </clock>
Aug 09 23:06:09 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:06:09 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:06:09 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:06:09 user nova-compute[72409]:   </cpu>
Aug 09 23:06:09 user nova-compute[72409]:   <devices>
Aug 09 23:06:09 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 23:06:09 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:06:09 user nova-compute[72409]:       <source dev="/dev/sde"/>
Aug 09 23:06:09 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:06:09 user nova-compute[72409]:       <serial>4ad73b76-b30a-4219-ac4c-7c96747e462a</serial>
Aug 09 23:06:09 user nova-compute[72409]:     </disk>
Aug 09 23:06:09 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:06:09 user nova-compute[72409]:       <mac address="fa:16:3e:f1:17:d5"/>
Aug 09 23:06:09 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:06:09 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:06:09 user nova-compute[72409]:       <target dev="tap39a8aeb7-12"/>
Aug 09 23:06:09 user nova-compute[72409]:     </interface>
Aug 09 23:06:09 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:06:09 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/438a2af8-be2a-48cb-af65-7ad4e1259c56/console.log" append="off"/>
Aug 09 23:06:09 user nova-compute[72409]:     </serial>
Aug 09 23:06:09 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:06:09 user nova-compute[72409]:     <video>
Aug 09 23:06:09 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:06:09 user nova-compute[72409]:     </video>
Aug 09 23:06:09 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:06:09 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:06:09 user nova-compute[72409]:     </rng>
Aug 09 23:06:09 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:06:09 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:06:09 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:06:09 user nova-compute[72409]:     </memballoon>
Aug 09 23:06:09 user nova-compute[72409]:   </devices>
Aug 09 23:06:09 user nova-compute[72409]: </domain>
Aug 09 23:06:09 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1576433463',display_name='tempest-TestVolumeBootPattern-server-1576433463',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1576433463',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1aHN+hYxllL5tuB8HvAlIacEjfYF+w1msAbdktrPPHCcF11JPXwNiBeUP+wL/G+SHuINuvHbsNfaNGa+fgVIlRHvAF1ETChrpZfHrOyvh53hIFQ9t/gmToggpOGTMoMw==',key_name='tempest-TestVolumeBootPattern-982211312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-292uo6yh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:05:58Z,user_data=None,user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=438a2af8-be2a-48cb-af65-7ad4e1259c56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "address": "fa:16:3e:f1:17:d5", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a8aeb7-12", "ovs_interfaceid": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "address": "fa:16:3e:f1:17:d5", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a8aeb7-12", "ovs_interfaceid": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:17:d5,bridge_name='br-int',has_traffic_filtering=True,id=39a8aeb7-1217-485f-b885-82bed5f3b3ef,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a8aeb7-12') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG os_vif [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:17:d5,bridge_name='br-int',has_traffic_filtering=True,id=39a8aeb7-1217-485f-b885-82bed5f3b3ef,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a8aeb7-12') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39a8aeb7-12, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39a8aeb7-12, col_values=(('external_ids', {'iface-id': '39a8aeb7-1217-485f-b885-82bed5f3b3ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:17:d5', 'vm-uuid': '438a2af8-be2a-48cb-af65-7ad4e1259c56'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:09 user nova-compute[72409]: INFO os_vif [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:17:d5,bridge_name='br-int',has_traffic_filtering=True,id=39a8aeb7-1217-485f-b885-82bed5f3b3ef,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a8aeb7-12')
Aug 09 23:06:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] No VIF found with MAC fa:16:3e:f1:17:d5, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:06:09 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:06:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-f730e30c-908e-40a6-b1ac-3f6a71642a2c req-aaf6ed8e-298f-4d5c-8ab8-fe6d7a6fb7ff service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Received event network-vif-plugged-39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:06:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f730e30c-908e-40a6-b1ac-3f6a71642a2c req-aaf6ed8e-298f-4d5c-8ab8-fe6d7a6fb7ff service nova] Acquiring lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f730e30c-908e-40a6-b1ac-3f6a71642a2c req-aaf6ed8e-298f-4d5c-8ab8-fe6d7a6fb7ff service nova] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f730e30c-908e-40a6-b1ac-3f6a71642a2c req-aaf6ed8e-298f-4d5c-8ab8-fe6d7a6fb7ff service nova] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:10 user nova-compute[72409]: DEBUG nova.compute.manager [req-f730e30c-908e-40a6-b1ac-3f6a71642a2c req-aaf6ed8e-298f-4d5c-8ab8-fe6d7a6fb7ff service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] No waiting events found dispatching network-vif-plugged-39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:06:10 user nova-compute[72409]: WARNING nova.compute.manager [req-f730e30c-908e-40a6-b1ac-3f6a71642a2c req-aaf6ed8e-298f-4d5c-8ab8-fe6d7a6fb7ff service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Received unexpected event network-vif-plugged-39a8aeb7-1217-485f-b885-82bed5f3b3ef for instance with vm_state building and task_state spawning.
Aug 09 23:06:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622372.8063703, 438a2af8-be2a-48cb-af65-7ad4e1259c56 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:06:12 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] VM Resumed (Lifecycle Event)
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:06:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Instance spawned successfully.
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-64e86588-f672-4e4f-91ba-09c9265411f4 req-1db98cfa-6ae9-4549-8b8c-525738c3521b service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Received event network-vif-plugged-39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-64e86588-f672-4e4f-91ba-09c9265411f4 req-1db98cfa-6ae9-4549-8b8c-525738c3521b service nova] Acquiring lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-64e86588-f672-4e4f-91ba-09c9265411f4 req-1db98cfa-6ae9-4549-8b8c-525738c3521b service nova] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-64e86588-f672-4e4f-91ba-09c9265411f4 req-1db98cfa-6ae9-4549-8b8c-525738c3521b service nova] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-64e86588-f672-4e4f-91ba-09c9265411f4 req-1db98cfa-6ae9-4549-8b8c-525738c3521b service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] No waiting events found dispatching network-vif-plugged-39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:06:12 user nova-compute[72409]: WARNING nova.compute.manager [req-64e86588-f672-4e4f-91ba-09c9265411f4 req-1db98cfa-6ae9-4549-8b8c-525738c3521b service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Received unexpected event network-vif-plugged-39a8aeb7-1217-485f-b885-82bed5f3b3ef for instance with vm_state building and task_state spawning.
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:06:12 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622372.8124514, 438a2af8-be2a-48cb-af65-7ad4e1259c56 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:06:12 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] VM Started (Lifecycle Event)
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:06:12 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:06:12 user nova-compute[72409]: INFO nova.compute.manager [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Took 5.30 seconds to spawn the instance on the hypervisor.
Aug 09 23:06:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:06:13 user nova-compute[72409]: INFO nova.compute.manager [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Took 16.29 seconds to build instance.
Aug 09 23:06:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-273d38f9-7a10-4518-b5ff-bf995077354f tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.382s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid b0c67c33-9d1a-4479-a64f-8f867330b9dc {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid c0f72ca0-06ef-444d-97d4-fca49bdde831 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid fbee7df5-5051-4064-bfa3-fa7a0da9c7aa {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid a074c83c-2e90-4675-89dc-4006294cfdee {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 438a2af8-be2a-48cb-af65-7ad4e1259c56 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "3f216945-199d-4047-8bc8-407d5842c536" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "a074c83c-2e90-4675-89dc-4006294cfdee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "438a2af8-be2a-48cb-af65-7ad4e1259c56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "3f216945-199d-4047-8bc8-407d5842c536" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "a074c83c-2e90-4675-89dc-4006294cfdee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:06:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:50 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:06:50 user nova-compute[72409]: INFO nova.compute.claims [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Claim successful on node user
Aug 09 23:06:50 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:06:50 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:06:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:06:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:06:50 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:06:50 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:06:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG nova.policy [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3e3ad0b3d954ebd816dc6b7c0a863eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28055127bfa44a1e8a8c2b79fae46838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:06:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Creating image(s)
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "/opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "/opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "/opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk 1073741824" returned: 0 in 0.051s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Cannot resize image /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'migration_context' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Ensure instance console log exists: /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Successfully created port: c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Going to confirm migration 2 {{(pid=72409) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquired lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG nova.network.neutron [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG nova.objects.instance [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'info_cache' on Instance uuid b0c67c33-9d1a-4479-a64f-8f867330b9dc {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Successfully updated port: c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "refresh_cache-e870efcb-fcb2-4dda-b92a-538fd06f16a7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquired lock "refresh_cache-e870efcb-fcb2-4dda-b92a-538fd06f16a7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG nova.network.neutron [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updating instance_info_cache with network_info: [{"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Releasing lock "refresh_cache-b0c67c33-9d1a-4479-a64f-8f867330b9dc" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG nova.objects.instance [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'migration_context' on Instance uuid b0c67c33-9d1a-4479-a64f-8f867330b9dc {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-e3aa2dd0-a90d-4023-b289-f0334428d015 req-8fb8d551-5153-4463-9066-452c2bbfb091 service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Received event network-changed-c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-e3aa2dd0-a90d-4023-b289-f0334428d015 req-8fb8d551-5153-4463-9066-452c2bbfb091 service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Refreshing instance network info cache due to event network-changed-c463ae05-66b4-4234-8fdb-7f449078b8e6. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e3aa2dd0-a90d-4023-b289-f0334428d015 req-8fb8d551-5153-4463-9066-452c2bbfb091 service nova] Acquiring lock "refresh_cache-e870efcb-fcb2-4dda-b92a-538fd06f16a7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:06:52 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Updating instance_info_cache with network_info: [{"id": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "address": "fa:16:3e:1e:a5:0b", "network": {"id": "a77ce7e5-f19c-4182-b6b9-52bdbd861868", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-539340574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28055127bfa44a1e8a8c2b79fae46838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc463ae05-66", "ovs_interfaceid": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Releasing lock "refresh_cache-e870efcb-fcb2-4dda-b92a-538fd06f16a7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Instance network_info: |[{"id": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "address": "fa:16:3e:1e:a5:0b", "network": {"id": "a77ce7e5-f19c-4182-b6b9-52bdbd861868", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-539340574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28055127bfa44a1e8a8c2b79fae46838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc463ae05-66", "ovs_interfaceid": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.394s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e3aa2dd0-a90d-4023-b289-f0334428d015 req-8fb8d551-5153-4463-9066-452c2bbfb091 service nova] Acquired lock "refresh_cache-e870efcb-fcb2-4dda-b92a-538fd06f16a7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.network.neutron [req-e3aa2dd0-a90d-4023-b289-f0334428d015 req-8fb8d551-5153-4463-9066-452c2bbfb091 service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Refreshing network info cache for port c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Start _get_guest_xml network_info=[{"id": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "address": "fa:16:3e:1e:a5:0b", "network": {"id": "a77ce7e5-f19c-4182-b6b9-52bdbd861868", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-539340574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28055127bfa44a1e8a8c2b79fae46838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc463ae05-66", "ovs_interfaceid": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:06:53 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:06:53 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-45550408',display_name='tempest-SnapshotDataIntegrityTests-server-45550408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-45550408',id=39,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9KKewf1o1KavPykvrzEet0vtqRfV4H4ollDfGqLgsLoj/drd85c6szCy59Plm0GlBGPxcr7Ka5fagayA0I8T6GKLR/xDQtaYg1/u2MSE8+jFygMy2zcnSsEMtbFafpLg==',key_name='tempest-keypair-1996619250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28055127bfa44a1e8a8c2b79fae46838',ramdisk_id='',reservation_id='r-nvq9frw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1092360722',owner_user_name='tempest-SnapshotDataIntegrityTests-1092360722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3e3ad0b3d954ebd816dc6b7c0a863eb',uuid=e870efcb-fcb2-4dda-b92a-538fd06f16a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "address": "fa:16:3e:1e:a5:0b", "network": {"id": "a77ce7e5-f19c-4182-b6b9-52bdbd861868", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-539340574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28055127bfa44a1e8a8c2b79fae46838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc463ae05-66", "ovs_interfaceid": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Converting VIF {"id": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "address": "fa:16:3e:1e:a5:0b", "network": {"id": "a77ce7e5-f19c-4182-b6b9-52bdbd861868", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-539340574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28055127bfa44a1e8a8c2b79fae46838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc463ae05-66", "ovs_interfaceid": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a5:0b,bridge_name='br-int',has_traffic_filtering=True,id=c463ae05-66b4-4234-8fdb-7f449078b8e6,network=Network(a77ce7e5-f19c-4182-b6b9-52bdbd861868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc463ae05-66') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'pci_devices' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:06:53 user nova-compute[72409]:   <uuid>e870efcb-fcb2-4dda-b92a-538fd06f16a7</uuid>
Aug 09 23:06:53 user nova-compute[72409]:   <name>instance-00000027</name>
Aug 09 23:06:53 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:06:53 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:06:53 user nova-compute[72409]:   <metadata>
Aug 09 23:06:53 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:06:53 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:06:53 user nova-compute[72409]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-45550408</nova:name>
Aug 09 23:06:53 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:06:53</nova:creationTime>
Aug 09 23:06:53 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:06:53 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:06:53 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:06:53 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:06:53 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:06:53 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:06:53 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:06:53 user nova-compute[72409]:       <nova:owner>
Aug 09 23:06:53 user nova-compute[72409]:         <nova:user uuid="d3e3ad0b3d954ebd816dc6b7c0a863eb">tempest-SnapshotDataIntegrityTests-1092360722-project-member</nova:user>
Aug 09 23:06:53 user nova-compute[72409]:         <nova:project uuid="28055127bfa44a1e8a8c2b79fae46838">tempest-SnapshotDataIntegrityTests-1092360722</nova:project>
Aug 09 23:06:53 user nova-compute[72409]:       </nova:owner>
Aug 09 23:06:53 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:06:53 user nova-compute[72409]:       <nova:ports>
Aug 09 23:06:53 user nova-compute[72409]:         <nova:port uuid="c463ae05-66b4-4234-8fdb-7f449078b8e6">
Aug 09 23:06:53 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 23:06:53 user nova-compute[72409]:         </nova:port>
Aug 09 23:06:53 user nova-compute[72409]:       </nova:ports>
Aug 09 23:06:53 user nova-compute[72409]:     </nova:instance>
Aug 09 23:06:53 user nova-compute[72409]:   </metadata>
Aug 09 23:06:53 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:06:53 user nova-compute[72409]:     <system>
Aug 09 23:06:53 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:06:53 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:06:53 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:06:53 user nova-compute[72409]:       <entry name="serial">e870efcb-fcb2-4dda-b92a-538fd06f16a7</entry>
Aug 09 23:06:53 user nova-compute[72409]:       <entry name="uuid">e870efcb-fcb2-4dda-b92a-538fd06f16a7</entry>
Aug 09 23:06:53 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:06:53 user nova-compute[72409]:     </system>
Aug 09 23:06:53 user nova-compute[72409]:   </sysinfo>
Aug 09 23:06:53 user nova-compute[72409]:   <os>
Aug 09 23:06:53 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:06:53 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:06:53 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:06:53 user nova-compute[72409]:   </os>
Aug 09 23:06:53 user nova-compute[72409]:   <features>
Aug 09 23:06:53 user nova-compute[72409]:     <acpi/>
Aug 09 23:06:53 user nova-compute[72409]:     <apic/>
Aug 09 23:06:53 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:06:53 user nova-compute[72409]:   </features>
Aug 09 23:06:53 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:06:53 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:06:53 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:06:53 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:06:53 user nova-compute[72409]:   </clock>
Aug 09 23:06:53 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:06:53 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:06:53 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:06:53 user nova-compute[72409]:   </cpu>
Aug 09 23:06:53 user nova-compute[72409]:   <devices>
Aug 09 23:06:53 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:06:53 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:06:53 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk"/>
Aug 09 23:06:53 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:06:53 user nova-compute[72409]:     </disk>
Aug 09 23:06:53 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:06:53 user nova-compute[72409]:       <mac address="fa:16:3e:1e:a5:0b"/>
Aug 09 23:06:53 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:06:53 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:06:53 user nova-compute[72409]:       <target dev="tapc463ae05-66"/>
Aug 09 23:06:53 user nova-compute[72409]:     </interface>
Aug 09 23:06:53 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:06:53 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/console.log" append="off"/>
Aug 09 23:06:53 user nova-compute[72409]:     </serial>
Aug 09 23:06:53 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:06:53 user nova-compute[72409]:     <video>
Aug 09 23:06:53 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:06:53 user nova-compute[72409]:     </video>
Aug 09 23:06:53 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:06:53 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:06:53 user nova-compute[72409]:     </rng>
Aug 09 23:06:53 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:06:53 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:06:53 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:06:53 user nova-compute[72409]:     </memballoon>
Aug 09 23:06:53 user nova-compute[72409]:   </devices>
Aug 09 23:06:53 user nova-compute[72409]: </domain>
Aug 09 23:06:53 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-45550408',display_name='tempest-SnapshotDataIntegrityTests-server-45550408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-45550408',id=39,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9KKewf1o1KavPykvrzEet0vtqRfV4H4ollDfGqLgsLoj/drd85c6szCy59Plm0GlBGPxcr7Ka5fagayA0I8T6GKLR/xDQtaYg1/u2MSE8+jFygMy2zcnSsEMtbFafpLg==',key_name='tempest-keypair-1996619250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28055127bfa44a1e8a8c2b79fae46838',ramdisk_id='',reservation_id='r-nvq9frw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1092360722',owner_user_name='tempest-SnapshotDataIntegrityTests-1092360722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3e3ad0b3d954ebd816dc6b7c0a863eb',uuid=e870efcb-fcb2-4dda-b92a-538fd06f16a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "address": "fa:16:3e:1e:a5:0b", "network": {"id": "a77ce7e5-f19c-4182-b6b9-52bdbd861868", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-539340574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28055127bfa44a1e8a8c2b79fae46838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc463ae05-66", "ovs_interfaceid": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Converting VIF {"id": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "address": "fa:16:3e:1e:a5:0b", "network": {"id": "a77ce7e5-f19c-4182-b6b9-52bdbd861868", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-539340574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28055127bfa44a1e8a8c2b79fae46838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc463ae05-66", "ovs_interfaceid": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a5:0b,bridge_name='br-int',has_traffic_filtering=True,id=c463ae05-66b4-4234-8fdb-7f449078b8e6,network=Network(a77ce7e5-f19c-4182-b6b9-52bdbd861868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc463ae05-66') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG os_vif [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a5:0b,bridge_name='br-int',has_traffic_filtering=True,id=c463ae05-66b4-4234-8fdb-7f449078b8e6,network=Network(a77ce7e5-f19c-4182-b6b9-52bdbd861868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc463ae05-66') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc463ae05-66, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc463ae05-66, col_values=(('external_ids', {'iface-id': 'c463ae05-66b4-4234-8fdb-7f449078b8e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:a5:0b', 'vm-uuid': 'e870efcb-fcb2-4dda-b92a-538fd06f16a7'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:53 user nova-compute[72409]: INFO os_vif [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a5:0b,bridge_name='br-int',has_traffic_filtering=True,id=c463ae05-66b4-4234-8fdb-7f449078b8e6,network=Network(a77ce7e5-f19c-4182-b6b9-52bdbd861868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc463ae05-66')
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No VIF found with MAC fa:16:3e:1e:a5:0b, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:06:53 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Deleted allocation for migration a255be55-f015-48b8-a5b2-4189b8075782
Aug 09 23:06:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-033c6781-acdb-49fb-a6c3-aefe2d7d27bd tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.574s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.network.neutron [req-e3aa2dd0-a90d-4023-b289-f0334428d015 req-8fb8d551-5153-4463-9066-452c2bbfb091 service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Updated VIF entry in instance network info cache for port c463ae05-66b4-4234-8fdb-7f449078b8e6. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG nova.network.neutron [req-e3aa2dd0-a90d-4023-b289-f0334428d015 req-8fb8d551-5153-4463-9066-452c2bbfb091 service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Updating instance_info_cache with network_info: [{"id": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "address": "fa:16:3e:1e:a5:0b", "network": {"id": "a77ce7e5-f19c-4182-b6b9-52bdbd861868", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-539340574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28055127bfa44a1e8a8c2b79fae46838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc463ae05-66", "ovs_interfaceid": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:06:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e3aa2dd0-a90d-4023-b289-f0334428d015 req-8fb8d551-5153-4463-9066-452c2bbfb091 service nova] Releasing lock "refresh_cache-e870efcb-fcb2-4dda-b92a-538fd06f16a7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:06:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-1a2e2b0c-ea77-4a91-b186-c675796cf4af req-7d7c9e6d-6ece-4788-a856-63feaa947f0f service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Received event network-vif-plugged-c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:06:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1a2e2b0c-ea77-4a91-b186-c675796cf4af req-7d7c9e6d-6ece-4788-a856-63feaa947f0f service nova] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1a2e2b0c-ea77-4a91-b186-c675796cf4af req-7d7c9e6d-6ece-4788-a856-63feaa947f0f service nova] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1a2e2b0c-ea77-4a91-b186-c675796cf4af req-7d7c9e6d-6ece-4788-a856-63feaa947f0f service nova] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-1a2e2b0c-ea77-4a91-b186-c675796cf4af req-7d7c9e6d-6ece-4788-a856-63feaa947f0f service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] No waiting events found dispatching network-vif-plugged-c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:06:55 user nova-compute[72409]: WARNING nova.compute.manager [req-1a2e2b0c-ea77-4a91-b186-c675796cf4af req-7d7c9e6d-6ece-4788-a856-63feaa947f0f service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Received unexpected event network-vif-plugged-c463ae05-66b4-4234-8fdb-7f449078b8e6 for instance with vm_state building and task_state spawning.
Aug 09 23:06:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:56 user nova-compute[72409]: INFO nova.compute.manager [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Terminating instance
Aug 09 23:06:56 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-3f547cfa-3d42-464c-9ef4-f1721f718501 req-f77140b6-ed0c-4c20-b762-12d3da54c6f5 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-vif-unplugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3f547cfa-3d42-464c-9ef4-f1721f718501 req-f77140b6-ed0c-4c20-b762-12d3da54c6f5 service nova] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3f547cfa-3d42-464c-9ef4-f1721f718501 req-f77140b6-ed0c-4c20-b762-12d3da54c6f5 service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3f547cfa-3d42-464c-9ef4-f1721f718501 req-f77140b6-ed0c-4c20-b762-12d3da54c6f5 service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-3f547cfa-3d42-464c-9ef4-f1721f718501 req-f77140b6-ed0c-4c20-b762-12d3da54c6f5 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] No waiting events found dispatching network-vif-unplugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:06:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-3f547cfa-3d42-464c-9ef4-f1721f718501 req-f77140b6-ed0c-4c20-b762-12d3da54c6f5 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-vif-unplugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Received event network-vif-plugged-c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] No waiting events found dispatching network-vif-plugged-c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:06:57 user nova-compute[72409]: WARNING nova.compute.manager [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Received unexpected event network-vif-plugged-c463ae05-66b4-4234-8fdb-7f449078b8e6 for instance with vm_state building and task_state spawning.
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-changed-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Refreshing instance network info cache due to event network-changed-f26d04f1-ec38-48a6-840e-cf9d48203a37. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] Acquiring lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] Acquired lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.network.neutron [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Refreshing network info cache for port f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:06:57 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Instance destroyed successfully.
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.objects.instance [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lazy-loading 'resources' on Instance uuid 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T23:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1632664094',display_name='tempest-TestShelveInstance-server-1632664094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1632664094',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8NPxIW8dauNF7Cj2dKVt0Ak8JhnH+OL70iAv7fTpL5cWW4ijcYvQcbU3noSyi8gma78yFO3e+E8YR8wDg+caQC9mIfpToXrSw/VLmfImnHV2Q7bUNwF0ZUbno4ZVsuxQ==',key_name='tempest-TestShelveInstance-26576457',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:05:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ac38a10bc4f46f8acdca4eec503b76f',ramdisk_id='',reservation_id='r-ztardyie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-381502409',owner_user_name='tempest-TestShelveInstance-381502409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:05:34Z,user_data=None,user_id='6357af30a40c4e9ebae912eabba0bb3e',uuid=4301cc62-4ca5-4b2f-bba2-0b3e0631adcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Converting VIF {"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_vif [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf26d04f1-ec, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:06:57 user nova-compute[72409]: INFO os_vif [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=f26d04f1-ec38-48a6-840e-cf9d48203a37,network=Network(08d284de-0f83-41d2-860f-93c6451870ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26d04f1-ec')
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxKwgsBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:06:57 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e394c5f-931f-46e7-bcb4-77dc5112f66d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a2a437-d9db-4163-b58f-b600f1fdff81]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:06:57 user nova-compute[72409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:06:57 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:06:57 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:06:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f (non-flash)
Aug 09 23:06:57 user nova-compute[72409]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:06:57 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:06:57 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:06:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84463e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0da42d-de57-4f91-8ed4-b19a6d48487c]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0fd531-1dbd-4868-b329-a970ef9baf55]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e3ce43-11c6-4078-922a-ed3961de32a5]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9386364-6999-410a-9171-b94c8273506e]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622417.4551346, e870efcb-fcb2-4dda-b92a-538fd06f16a7 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:06:57 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] VM Resumed (Lifecycle Event)
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO38fb2ee2-06c4b8681aff659c', '/dev/disk/by-id/scsi-23036633462383638', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_38fb2ee2') {{(pid=83250) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[236c222c-6b8f-4177-aefc-8ab9d84d5b24]: (4, None) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:57 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Instance spawned successfully.
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0d059e-f952-4276-9f4b-9a675798b1cc]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:06:57 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622417.4629524, e870efcb-fcb2-4dda-b92a-538fd06f16a7 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:06:57 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] VM Started (Lifecycle Event)
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3df2af-b73d-45af-8821-6a821cfa941f]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260]
Aug 09 23:06:57 user nova-compute[72409]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f, portal: 172.16.0.220,3260] successful.
Aug 09 23:06:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:06:57 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:06:57 user nova-compute[72409]: INFO nova.compute.manager [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Took 6.47 seconds to spawn the instance on the hypervisor.
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fec0e3-71b7-473e-b72a-5f9656c2c15f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b31587d-f61e-41bb-a48d-ba18efdc8e95]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] <== disconnect_volume: return (347ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:06:57 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Deleting instance files /opt/stack/data/nova/instances/4301cc62-4ca5-4b2f-bba2-0b3e0631adcf_del
Aug 09 23:06:57 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Deletion of /opt/stack/data/nova/instances/4301cc62-4ca5-4b2f-bba2-0b3e0631adcf_del complete
Aug 09 23:06:57 user nova-compute[72409]: INFO nova.compute.manager [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:06:57 user nova-compute[72409]: INFO nova.compute.manager [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Took 7.52 seconds to build instance.
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a36c332a-9f6e-4e6c-a1df-828ab19e0886 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.625s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.network.neutron [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updated VIF entry in instance network info cache for port f26d04f1-ec38-48a6-840e-cf9d48203a37. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG nova.network.neutron [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updating instance_info_cache with network_info: [{"id": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "address": "fa:16:3e:4b:67:e5", "network": {"id": "08d284de-0f83-41d2-860f-93c6451870ed", "bridge": "br-int", "label": "tempest-TestShelveInstance-361414912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ac38a10bc4f46f8acdca4eec503b76f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26d04f1-ec", "ovs_interfaceid": "f26d04f1-ec38-48a6-840e-cf9d48203a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-88f2dedd-53dc-4f16-8781-4fa7172c6d62 req-40b14204-df7e-4b22-ae6c-624b35a3c8ad service nova] Releasing lock "refresh_cache-4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:06:57 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:06:58 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:06:58 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Took 0.57 seconds to deallocate network for instance.
Aug 09 23:06:58 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:06:58 user nova-compute[72409]: DEBUG nova.compute.manager [req-06352595-2976-46bc-aba7-6e236341fb75 req-5bd22f66-19bc-4e18-8785-d2e5ce8e7c74 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:06:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-06352595-2976-46bc-aba7-6e236341fb75 req-5bd22f66-19bc-4e18-8785-d2e5ce8e7c74 service nova] Acquiring lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-06352595-2976-46bc-aba7-6e236341fb75 req-5bd22f66-19bc-4e18-8785-d2e5ce8e7c74 service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-06352595-2976-46bc-aba7-6e236341fb75 req-5bd22f66-19bc-4e18-8785-d2e5ce8e7c74 service nova] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:58 user nova-compute[72409]: DEBUG nova.compute.manager [req-06352595-2976-46bc-aba7-6e236341fb75 req-5bd22f66-19bc-4e18-8785-d2e5ce8e7c74 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] No waiting events found dispatching network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:06:58 user nova-compute[72409]: WARNING nova.compute.manager [req-06352595-2976-46bc-aba7-6e236341fb75 req-5bd22f66-19bc-4e18-8785-d2e5ce8e7c74 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received unexpected event network-vif-plugged-f26d04f1-ec38-48a6-840e-cf9d48203a37 for instance with vm_state active and task_state deleting.
Aug 09 23:06:59 user nova-compute[72409]: INFO nova.compute.manager [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Took 0.86 seconds to detach 1 volumes for instance.
Aug 09 23:06:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Deleting volume: c4fec0e3-71b7-473e-b72a-5f9656c2c15f {{(pid=72409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 23:06:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:06:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:06:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-3e5be1af-2c59-4ac5-bd44-fed7827cc17f req-9007206b-c01c-4ea9-bdba-dd29e0b68db2 service nova] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Received event network-vif-deleted-f26d04f1-ec38-48a6-840e-cf9d48203a37 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:06:59 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:06:59 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:06:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:06:59 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Deleted allocations for instance 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf
Aug 09 23:06:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d60a8db7-f6a9-454f-a9ca-caec58a8a47a tempest-TestShelveInstance-381502409 tempest-TestShelveInstance-381502409-project-member] Lock "4301cc62-4ca5-4b2f-bba2-0b3e0631adcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.285s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-557d9ba0-4a05-4c5a-98f2-3a7cec570a86 req-be59881b-d34b-4e3e-892b-c2d6c6a613c2 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Received event network-changed-2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-557d9ba0-4a05-4c5a-98f2-3a7cec570a86 req-be59881b-d34b-4e3e-892b-c2d6c6a613c2 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Refreshing instance network info cache due to event network-changed-2a923c01-b708-4bc5-ae85-88372217085c. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:07:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-557d9ba0-4a05-4c5a-98f2-3a7cec570a86 req-be59881b-d34b-4e3e-892b-c2d6c6a613c2 service nova] Acquiring lock "refresh_cache-fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:07:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-557d9ba0-4a05-4c5a-98f2-3a7cec570a86 req-be59881b-d34b-4e3e-892b-c2d6c6a613c2 service nova] Acquired lock "refresh_cache-fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:07:01 user nova-compute[72409]: DEBUG nova.network.neutron [req-557d9ba0-4a05-4c5a-98f2-3a7cec570a86 req-be59881b-d34b-4e3e-892b-c2d6c6a613c2 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Refreshing network info cache for port 2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:07:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG nova.network.neutron [req-557d9ba0-4a05-4c5a-98f2-3a7cec570a86 req-be59881b-d34b-4e3e-892b-c2d6c6a613c2 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Updated VIF entry in instance network info cache for port 2a923c01-b708-4bc5-ae85-88372217085c. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG nova.network.neutron [req-557d9ba0-4a05-4c5a-98f2-3a7cec570a86 req-be59881b-d34b-4e3e-892b-c2d6c6a613c2 service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Updating instance_info_cache with network_info: [{"id": "2a923c01-b708-4bc5-ae85-88372217085c", "address": "fa:16:3e:36:7f:c2", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a923c01-b7", "ovs_interfaceid": "2a923c01-b708-4bc5-ae85-88372217085c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-557d9ba0-4a05-4c5a-98f2-3a7cec570a86 req-be59881b-d34b-4e3e-892b-c2d6c6a613c2 service nova] Releasing lock "refresh_cache-fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lazy-loading 'flavor' on Instance uuid fbee7df5-5051-4064-bfa3-fa7a0da9c7aa {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:07:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Ignoring supplied device name: /dev/vdb
Aug 09 23:07:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:02 user nova-compute[72409]: INFO nova.compute.manager [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Attaching volume b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 to /dev/vdb
Aug 09 23:07:02 user nova-compute[72409]: DEBUG os_brick.utils [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:07:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8e334f-f849-43e4-b417-a9090022ae76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81544a1-fef0-4ada-978c-527e79576a1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4af157-2567-45d5-a6d0-7d4bea1348cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6c41d7-a690-424a-bb3b-a14473afc366]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:07:03 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a592733-9e28-4774-9470-4274625a3e11]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG os_brick.utils [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Updating existing volume attachment record: c2ebac5a-4afd-4062-97c2-6e5dd3a75018 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-739fed90-32f3-45aa-960b-6a9f27913161 req-6e6d0aaa-741a-4521-b075-1a1a62c5eeee service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-changed-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-739fed90-32f3-45aa-960b-6a9f27913161 req-6e6d0aaa-741a-4521-b075-1a1a62c5eeee service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Refreshing instance network info cache due to event network-changed-471b5fc0-921e-4944-b012-6d2cdcb0f246. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-739fed90-32f3-45aa-960b-6a9f27913161 req-6e6d0aaa-741a-4521-b075-1a1a62c5eeee service nova] Acquiring lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-739fed90-32f3-45aa-960b-6a9f27913161 req-6e6d0aaa-741a-4521-b075-1a1a62c5eeee service nova] Acquired lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG nova.network.neutron [req-739fed90-32f3-45aa-960b-6a9f27913161 req-6e6d0aaa-741a-4521-b075-1a1a62c5eeee service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Refreshing network info cache for port 471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG nova.network.neutron [req-739fed90-32f3-45aa-960b-6a9f27913161 req-6e6d0aaa-741a-4521-b075-1a1a62c5eeee service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updated VIF entry in instance network info cache for port 471b5fc0-921e-4944-b012-6d2cdcb0f246. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG nova.network.neutron [req-739fed90-32f3-45aa-960b-6a9f27913161 req-6e6d0aaa-741a-4521-b075-1a1a62c5eeee service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updating instance_info_cache with network_info: [{"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-739fed90-32f3-45aa-960b-6a9f27913161 req-6e6d0aaa-741a-4521-b075-1a1a62c5eeee service nova] Releasing lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:07:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:07:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:05 user nova-compute[72409]: INFO nova.compute.manager [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] instance snapshotting
Aug 09 23:07:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:05 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Beginning live snapshot process
Aug 09 23:07:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:07:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:07:06 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:07:06 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7316MB free_disk=25.338401794433594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json -f qcow2 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c0f72ca0-06ef-444d-97d4-fca49bdde831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance b0c67c33-9d1a-4479-a64f-8f867330b9dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance fbee7df5-5051-4064-bfa3-fa7a0da9c7aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a75a5458-8710-425d-9755-dc2dc71f7d5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 438a2af8-be2a-48cb-af65-7ad4e1259c56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json -f qcow2 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqe11ypf7/3f0218ce9af4405c932a9d00a810d3ab.delta 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqe11ypf7/3f0218ce9af4405c932a9d00a810d3ab.delta 1073741824" returned: 0 in 0.074s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:06 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.742s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 23:07:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] COPY block job progress, current cursor: 47448064 final cursor: 75497472 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 23:07:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 23:07:08 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 23:07:08 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 23:07:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqe11ypf7/3f0218ce9af4405c932a9d00a810d3ab.delta /opt/stack/data/nova/instances/snapshots/tmpqe11ypf7/3f0218ce9af4405c932a9d00a810d3ab {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:08 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:07:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:07:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:07:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:07:08 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:07:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqe11ypf7/3f0218ce9af4405c932a9d00a810d3ab.delta /opt/stack/data/nova/instances/snapshots/tmpqe11ypf7/3f0218ce9af4405c932a9d00a810d3ab" returned: 0 in 0.602s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:09 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Snapshot extracted, beginning image upload
Aug 09 23:07:09 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updating instance_info_cache with network_info: [{"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:07:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:07:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:07:09 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:07:09 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:07:09 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:07:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:07:09 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:07:11 user nova-compute[72409]: INFO nova.compute.manager [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Rescuing
Aug 09 23:07:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:07:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquired lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:07:11 user nova-compute[72409]: DEBUG nova.network.neutron [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:07:11 user nova-compute[72409]: DEBUG nova.network.neutron [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Updating instance_info_cache with network_info: [{"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:07:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Releasing lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:07:11 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Snapshot image upload complete
Aug 09 23:07:11 user nova-compute[72409]: INFO nova.compute.manager [None req-fa18d2c5-bbda-4af0-8b72-35a78d907419 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Took 6.53 seconds to snapshot the instance on the hypervisor.
Aug 09 23:07:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-e1afc175-dd6b-4170-8217-ccc1273f1d5e req-643aced5-58db-44b0-b45a-8a50e3ba16f8 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received event network-vif-unplugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e1afc175-dd6b-4170-8217-ccc1273f1d5e req-643aced5-58db-44b0-b45a-8a50e3ba16f8 service nova] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e1afc175-dd6b-4170-8217-ccc1273f1d5e req-643aced5-58db-44b0-b45a-8a50e3ba16f8 service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e1afc175-dd6b-4170-8217-ccc1273f1d5e req-643aced5-58db-44b0-b45a-8a50e3ba16f8 service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.compute.manager [req-e1afc175-dd6b-4170-8217-ccc1273f1d5e req-643aced5-58db-44b0-b45a-8a50e3ba16f8 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] No waiting events found dispatching network-vif-unplugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:07:12 user nova-compute[72409]: WARNING nova.compute.manager [req-e1afc175-dd6b-4170-8217-ccc1273f1d5e req-643aced5-58db-44b0-b45a-8a50e3ba16f8 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received unexpected event network-vif-unplugged-7849914d-f21b-4fcc-b83c-47dc070987ec for instance with vm_state active and task_state rescuing.
Aug 09 23:07:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622417.2061315, 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:07:12 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] VM Stopped (Lifecycle Event)
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e1c06095-7e28-4b0c-9241-2315be532dde None None] [instance: 4301cc62-4ca5-4b2f-bba2-0b3e0631adcf] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Instance destroyed successfully.
Aug 09 23:07:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Attempting rescue
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72409) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Instance directory exists: not creating {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 23:07:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Creating image(s)
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "/opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "/opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "/opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.objects.instance [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'trusted_certs' on Instance uuid a074c83c-2e90-4675-89dc-4006294cfdee {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue" returned: 0 in 0.055s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.objects.instance [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'migration_context' on Instance uuid a074c83c-2e90-4675-89dc-4006294cfdee {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Start _get_guest_xml network_info=[{"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "vif_mac": "fa:16:3e:cf:d5:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.objects.instance [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'resources' on Instance uuid a074c83c-2e90-4675-89dc-4006294cfdee {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.objects.instance [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'numa_topology' on Instance uuid a074c83c-2e90-4675-89dc-4006294cfdee {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsmOXGRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:07:12 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:07:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:07:12 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:07:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:07:12 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:12 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:07:12 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ddfcce-94ce-4b19-8547-526f4b717267]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:07:12 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.objects.instance [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'vcpu_model' on Instance uuid a074c83c-2e90-4675-89dc-4006294cfdee {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2016255152',display_name='tempest-ServerRescueNegativeTestJSON-server-2016255152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2016255152',id=37,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:05:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d41897ed2b644775a5dcb22d1ecd60a0',ramdisk_id='',reservation_id='r-zlpivyg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-850997564',owner_user_name='tempest-ServerRescueNegativeTestJSON-850997564-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:05:31Z,user_data=None,user_id='de2d9f7ad5bb4a93ab61ab100eb1778d',uuid=a074c83c-2e90-4675-89dc-4006294cfdee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "vif_mac": "fa:16:3e:cf:d5:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converting VIF {"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "vif_mac": "fa:16:3e:cf:d5:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:d5:11,bridge_name='br-int',has_traffic_filtering=True,id=7849914d-f21b-4fcc-b83c-47dc070987ec,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7849914d-f2') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.objects.instance [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'pci_devices' on Instance uuid a074c83c-2e90-4675-89dc-4006294cfdee {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9dee6d-0412-40b4-87f7-5c4783d28ac7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3] added
Aug 09 23:07:12 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:07:12 user nova-compute[72409]:   <uuid>a074c83c-2e90-4675-89dc-4006294cfdee</uuid>
Aug 09 23:07:12 user nova-compute[72409]:   <name>instance-00000025</name>
Aug 09 23:07:12 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:07:12 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:07:12 user nova-compute[72409]:   <metadata>
Aug 09 23:07:12 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:07:12 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:07:12 user nova-compute[72409]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2016255152</nova:name>
Aug 09 23:07:12 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:07:12</nova:creationTime>
Aug 09 23:07:12 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:07:12 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:07:12 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:07:12 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:07:12 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:07:12 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:07:12 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:07:12 user nova-compute[72409]:       <nova:owner>
Aug 09 23:07:12 user nova-compute[72409]:         <nova:user uuid="de2d9f7ad5bb4a93ab61ab100eb1778d">tempest-ServerRescueNegativeTestJSON-850997564-project-member</nova:user>
Aug 09 23:07:12 user nova-compute[72409]:         <nova:project uuid="d41897ed2b644775a5dcb22d1ecd60a0">tempest-ServerRescueNegativeTestJSON-850997564</nova:project>
Aug 09 23:07:12 user nova-compute[72409]:       </nova:owner>
Aug 09 23:07:12 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:07:12 user nova-compute[72409]:       <nova:ports>
Aug 09 23:07:12 user nova-compute[72409]:         <nova:port uuid="7849914d-f21b-4fcc-b83c-47dc070987ec">
Aug 09 23:07:12 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 23:07:12 user nova-compute[72409]:         </nova:port>
Aug 09 23:07:12 user nova-compute[72409]:       </nova:ports>
Aug 09 23:07:12 user nova-compute[72409]:     </nova:instance>
Aug 09 23:07:12 user nova-compute[72409]:   </metadata>
Aug 09 23:07:12 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:07:12 user nova-compute[72409]:     <system>
Aug 09 23:07:12 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:07:12 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:07:12 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:07:12 user nova-compute[72409]:       <entry name="serial">a074c83c-2e90-4675-89dc-4006294cfdee</entry>
Aug 09 23:07:12 user nova-compute[72409]:       <entry name="uuid">a074c83c-2e90-4675-89dc-4006294cfdee</entry>
Aug 09 23:07:12 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:07:12 user nova-compute[72409]:     </system>
Aug 09 23:07:12 user nova-compute[72409]:   </sysinfo>
Aug 09 23:07:12 user nova-compute[72409]:   <os>
Aug 09 23:07:12 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:07:12 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:07:12 user nova-compute[72409]:   </os>
Aug 09 23:07:12 user nova-compute[72409]:   <features>
Aug 09 23:07:12 user nova-compute[72409]:     <acpi/>
Aug 09 23:07:12 user nova-compute[72409]:     <apic/>
Aug 09 23:07:12 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:07:12 user nova-compute[72409]:   </features>
Aug 09 23:07:12 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:07:12 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:07:12 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:07:12 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:07:12 user nova-compute[72409]:   </clock>
Aug 09 23:07:12 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:07:12 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:07:12 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:07:12 user nova-compute[72409]:   </cpu>
Aug 09 23:07:12 user nova-compute[72409]:   <devices>
Aug 09 23:07:12 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:07:12 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:07:12 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue"/>
Aug 09 23:07:12 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:07:12 user nova-compute[72409]:     </disk>
Aug 09 23:07:12 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:07:12 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:07:12 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk"/>
Aug 09 23:07:12 user nova-compute[72409]:       <target dev="vdb" bus="virtio"/>
Aug 09 23:07:12 user nova-compute[72409]:     </disk>
Aug 09 23:07:12 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:07:12 user nova-compute[72409]:       <mac address="fa:16:3e:cf:d5:11"/>
Aug 09 23:07:12 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:07:12 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:07:12 user nova-compute[72409]:       <target dev="tap7849914d-f2"/>
Aug 09 23:07:12 user nova-compute[72409]:     </interface>
Aug 09 23:07:12 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:07:12 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/console.log" append="off"/>
Aug 09 23:07:12 user nova-compute[72409]:     </serial>
Aug 09 23:07:12 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:07:12 user nova-compute[72409]:     <video>
Aug 09 23:07:12 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:07:12 user nova-compute[72409]:     </video>
Aug 09 23:07:12 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:07:12 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:07:12 user nova-compute[72409]:     </rng>
Aug 09 23:07:12 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:07:12 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:07:12 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:07:12 user nova-compute[72409]:     </memballoon>
Aug 09 23:07:12 user nova-compute[72409]:   </devices>
Aug 09 23:07:12 user nova-compute[72409]: </domain>
Aug 09 23:07:12 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:07:12 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Instance destroyed successfully.
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdbe02b-235a-421d-a71a-58e66383382f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[413a93f2-51b5-450a-a8cf-d3fa449da2d1]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsmOXGRA {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsmOXGRA" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a979bbd5-047a-4c76-8da2-6516d94e5705]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DsmOXGRA'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:07:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No VIF found with MAC fa:16:3e:cf:d5:11, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e181476-a008-4783-a4ed-317135434518]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5a454f-f037-4a14-b8a3-9aaf6012b38a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:07:13 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:07:13 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:07:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:07:13 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:07:13 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:07:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4df7527-ab46-4818-8695-bec66c1643f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3, portal: 172.16.0.220,3260]
Aug 09 23:07:13 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3, portal: 172.16.0.220,3260] successful.
Aug 09 23:07:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae9b7ff-0bbf-4d52-9570-2ecf660a9f28]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea3c203-f805-409d-aa65-03ff9fffb167]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:07:13 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:07:13 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:07:13 user nova-compute[72409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 (non-flash)
Aug 09 23:07:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:07:13 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:07:13 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:07:13 user nova-compute[72409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 (non-flash)
Aug 09 23:07:13 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb93bc0-4b9c-4fe0-b4c0-d57ca0073fd1]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:07:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsmOXGRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-c05e6fc8-8d5b-4d79-aa23-db37db32b582 req-f27d37c1-74bd-41a6-ae2a-644b9ff3c090 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received event network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c05e6fc8-8d5b-4d79-aa23-db37db32b582 req-f27d37c1-74bd-41a6-ae2a-644b9ff3c090 service nova] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c05e6fc8-8d5b-4d79-aa23-db37db32b582 req-f27d37c1-74bd-41a6-ae2a-644b9ff3c090 service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c05e6fc8-8d5b-4d79-aa23-db37db32b582 req-f27d37c1-74bd-41a6-ae2a-644b9ff3c090 service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG nova.compute.manager [req-c05e6fc8-8d5b-4d79-aa23-db37db32b582 req-f27d37c1-74bd-41a6-ae2a-644b9ff3c090 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] No waiting events found dispatching network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:07:14 user nova-compute[72409]: WARNING nova.compute.manager [req-c05e6fc8-8d5b-4d79-aa23-db37db32b582 req-f27d37c1-74bd-41a6-ae2a-644b9ff3c090 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received unexpected event network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec for instance with vm_state active and task_state rescuing.
Aug 09 23:07:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26261346530326235', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261346530326235', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lazy-loading 'flavor' on Instance uuid fbee7df5-5051-4064-bfa3-fa7a0da9c7aa {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:07:14 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:07:14 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:07:14 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:07:14 user nova-compute[72409]:   <serial>b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3</serial>
Aug 09 23:07:14 user nova-compute[72409]: </disk>
Aug 09 23:07:14 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] No VIF found with MAC fa:16:3e:36:7f:c2, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:07:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8fef5a34-690c-4ce3-909d-2eb364d13fa7 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.042s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-0a144605-48ff-44c4-b30f-346ac191bb57 req-68de6fc5-98bc-4b46-b4fe-7491a82c069e service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received event network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0a144605-48ff-44c4-b30f-346ac191bb57 req-68de6fc5-98bc-4b46-b4fe-7491a82c069e service nova] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0a144605-48ff-44c4-b30f-346ac191bb57 req-68de6fc5-98bc-4b46-b4fe-7491a82c069e service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0a144605-48ff-44c4-b30f-346ac191bb57 req-68de6fc5-98bc-4b46-b4fe-7491a82c069e service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-0a144605-48ff-44c4-b30f-346ac191bb57 req-68de6fc5-98bc-4b46-b4fe-7491a82c069e service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] No waiting events found dispatching network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:07:16 user nova-compute[72409]: WARNING nova.compute.manager [req-0a144605-48ff-44c4-b30f-346ac191bb57 req-68de6fc5-98bc-4b46-b4fe-7491a82c069e service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received unexpected event network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec for instance with vm_state active and task_state rescuing.
Aug 09 23:07:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-0a144605-48ff-44c4-b30f-346ac191bb57 req-68de6fc5-98bc-4b46-b4fe-7491a82c069e service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received event network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0a144605-48ff-44c4-b30f-346ac191bb57 req-68de6fc5-98bc-4b46-b4fe-7491a82c069e service nova] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0a144605-48ff-44c4-b30f-346ac191bb57 req-68de6fc5-98bc-4b46-b4fe-7491a82c069e service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0a144605-48ff-44c4-b30f-346ac191bb57 req-68de6fc5-98bc-4b46-b4fe-7491a82c069e service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-0a144605-48ff-44c4-b30f-346ac191bb57 req-68de6fc5-98bc-4b46-b4fe-7491a82c069e service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] No waiting events found dispatching network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:07:16 user nova-compute[72409]: WARNING nova.compute.manager [req-0a144605-48ff-44c4-b30f-346ac191bb57 req-68de6fc5-98bc-4b46-b4fe-7491a82c069e service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received unexpected event network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec for instance with vm_state active and task_state rescuing.
Aug 09 23:07:16 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Removed pending event for a074c83c-2e90-4675-89dc-4006294cfdee due to event {{(pid=72409) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622436.8019757, a074c83c-2e90-4675-89dc-4006294cfdee => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:07:16 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] VM Resumed (Lifecycle Event)
Aug 09 23:07:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-393370b8-067c-4cb8-a1c1-56c4153f699d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:07:16 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 23:07:16 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622436.80722, a074c83c-2e90-4675-89dc-4006294cfdee => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:07:16 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] VM Started (Lifecycle Event)
Aug 09 23:07:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:07:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-753bcc3c-edb7-4835-843e-22a583c77df6 req-eef5a75d-c70e-4b12-9b82-133219197304 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-changed-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-753bcc3c-edb7-4835-843e-22a583c77df6 req-eef5a75d-c70e-4b12-9b82-133219197304 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Refreshing instance network info cache due to event network-changed-72040fc9-f3df-43df-a3e4-c5ba8c410187. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:07:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-753bcc3c-edb7-4835-843e-22a583c77df6 req-eef5a75d-c70e-4b12-9b82-133219197304 service nova] Acquiring lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:07:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-753bcc3c-edb7-4835-843e-22a583c77df6 req-eef5a75d-c70e-4b12-9b82-133219197304 service nova] Acquired lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:07:32 user nova-compute[72409]: DEBUG nova.network.neutron [req-753bcc3c-edb7-4835-843e-22a583c77df6 req-eef5a75d-c70e-4b12-9b82-133219197304 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Refreshing network info cache for port 72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:07:33 user nova-compute[72409]: DEBUG nova.network.neutron [req-753bcc3c-edb7-4835-843e-22a583c77df6 req-eef5a75d-c70e-4b12-9b82-133219197304 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updated VIF entry in instance network info cache for port 72040fc9-f3df-43df-a3e4-c5ba8c410187. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:07:33 user nova-compute[72409]: DEBUG nova.network.neutron [req-753bcc3c-edb7-4835-843e-22a583c77df6 req-eef5a75d-c70e-4b12-9b82-133219197304 service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updating instance_info_cache with network_info: [{"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:07:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-753bcc3c-edb7-4835-843e-22a583c77df6 req-eef5a75d-c70e-4b12-9b82-133219197304 service nova] Releasing lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:07:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-b93de971-634e-4c96-8c5b-c94d615c2cc5 req-200a3cb3-ada1-465d-af63-4a9acad2137d service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-changed-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-b93de971-634e-4c96-8c5b-c94d615c2cc5 req-200a3cb3-ada1-465d-af63-4a9acad2137d service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Refreshing instance network info cache due to event network-changed-72040fc9-f3df-43df-a3e4-c5ba8c410187. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:07:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b93de971-634e-4c96-8c5b-c94d615c2cc5 req-200a3cb3-ada1-465d-af63-4a9acad2137d service nova] Acquiring lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:07:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b93de971-634e-4c96-8c5b-c94d615c2cc5 req-200a3cb3-ada1-465d-af63-4a9acad2137d service nova] Acquired lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:07:33 user nova-compute[72409]: DEBUG nova.network.neutron [req-b93de971-634e-4c96-8c5b-c94d615c2cc5 req-200a3cb3-ada1-465d-af63-4a9acad2137d service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Refreshing network info cache for port 72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:07:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:33 user nova-compute[72409]: INFO nova.compute.manager [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Detaching volume a12b857d-36ba-4bb9-8d0f-6e71f640daed
Aug 09 23:07:34 user nova-compute[72409]: INFO nova.virt.block_device [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Attempting to driver detach volume a12b857d-36ba-4bb9-8d0f-6e71f640daed from mountpoint /dev/vdb
Aug 09 23:07:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Attempting to detach device vdb from instance c0f72ca0-06ef-444d-97d4-fca49bdde831 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:07:34 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:07:34 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:07:34 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:07:34 user nova-compute[72409]:   <serial>a12b857d-36ba-4bb9-8d0f-6e71f640daed</serial>
Aug 09 23:07:34 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:07:34 user nova-compute[72409]: </disk>
Aug 09 23:07:34 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:07:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Successfully detached device vdb from instance c0f72ca0-06ef-444d-97d4-fca49bdde831 from the persistent domain config.
Aug 09 23:07:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c0f72ca0-06ef-444d-97d4-fca49bdde831 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:07:34 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:07:34 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:07:34 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:07:34 user nova-compute[72409]:   <serial>a12b857d-36ba-4bb9-8d0f-6e71f640daed</serial>
Aug 09 23:07:34 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:07:34 user nova-compute[72409]: </disk>
Aug 09 23:07:34 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG nova.network.neutron [req-b93de971-634e-4c96-8c5b-c94d615c2cc5 req-200a3cb3-ada1-465d-af63-4a9acad2137d service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updated VIF entry in instance network info cache for port 72040fc9-f3df-43df-a3e4-c5ba8c410187. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG nova.network.neutron [req-b93de971-634e-4c96-8c5b-c94d615c2cc5 req-200a3cb3-ada1-465d-af63-4a9acad2137d service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updating instance_info_cache with network_info: [{"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b93de971-634e-4c96-8c5b-c94d615c2cc5 req-200a3cb3-ada1-465d-af63-4a9acad2137d service nova] Releasing lock "refresh_cache-c0f72ca0-06ef-444d-97d4-fca49bdde831" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622454.553762, c0f72ca0-06ef-444d-97d4-fca49bdde831 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c0f72ca0-06ef-444d-97d4-fca49bdde831 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:07:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Successfully detached device vdb from instance c0f72ca0-06ef-444d-97d4-fca49bdde831 from the live domain config.
Aug 09 23:07:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPQJTcNZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:07:34 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce52c35-5be1-49eb-aa17-ea00bf7d0a93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd55ec5-68a2-4026-876f-6842bf083ae6]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:07:34 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:07:34 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:07:34 user nova-compute[72409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 (non-flash)
Aug 09 23:07:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed (non-flash)
Aug 09 23:07:34 user nova-compute[72409]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:07:34 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:07:34 user nova-compute[72409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 (non-flash)
Aug 09 23:07:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e843a6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e253e3b5-1700-4347-bcc5-4f1553e88ccd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2039af3-ab3f-4933-bafc-fc66674fdcc5]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0d3952-6eda-4835-aac1-7a633ebf5f17]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[45389fc1-4193-47c1-bd39-ad9f4ab104e9]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96bb6db-80fc-4118-8ecd-c3892e9dc5b0]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --logout" returned: 0 in 0.111s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefdab1f-34c4-44cd-8227-3cc9e32c3721]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed, portal: 172.16.0.220,3260]
Aug 09 23:07:34 user nova-compute[72409]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed, portal: 172.16.0.220,3260] successful.
Aug 09 23:07:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a12b857d-36ba-4bb9-8d0f-6e71f640daed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b844934-6311-4795-8e15-40f136176854]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] <== disconnect_volume: return (336ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:07:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:07:35 user nova-compute[72409]: DEBUG nova.objects.instance [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'flavor' on Instance uuid c0f72ca0-06ef-444d-97d4-fca49bdde831 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:07:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ac2deb5f-d57c-4bcd-8018-b03fa05d2c37 tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.696s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:45 user nova-compute[72409]: INFO nova.compute.manager [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Detaching volume b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3
Aug 09 23:07:45 user nova-compute[72409]: INFO nova.virt.block_device [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Attempting to driver detach volume b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 from mountpoint /dev/vdb
Aug 09 23:07:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Attempting to detach device vdb from instance fbee7df5-5051-4064-bfa3-fa7a0da9c7aa from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:07:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:07:45 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:07:45 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:07:45 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:07:45 user nova-compute[72409]:   <serial>b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3</serial>
Aug 09 23:07:45 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:07:45 user nova-compute[72409]: </disk>
Aug 09 23:07:45 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:07:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Successfully detached device vdb from instance fbee7df5-5051-4064-bfa3-fa7a0da9c7aa from the persistent domain config.
Aug 09 23:07:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fbee7df5-5051-4064-bfa3-fa7a0da9c7aa from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:07:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:07:45 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:07:45 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:07:45 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:07:45 user nova-compute[72409]:   <serial>b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3</serial>
Aug 09 23:07:45 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:07:45 user nova-compute[72409]: </disk>
Aug 09 23:07:45 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:07:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622466.3888426, fbee7df5-5051-4064-bfa3-fa7a0da9c7aa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fbee7df5-5051-4064-bfa3-fa7a0da9c7aa {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:07:46 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Successfully detached device vdb from instance fbee7df5-5051-4064-bfa3-fa7a0da9c7aa from the live domain config.
Aug 09 23:07:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsmOXGRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:07:46 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0eebf8-95e8-4121-8b05-eb6d1ae154f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78ccc09-12a1-4977-a6d7-53fa90e45053]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:07:46 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:07:46 user nova-compute[72409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 (non-flash)
Aug 09 23:07:46 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:07:46 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:07:46 user nova-compute[72409]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 (non-flash)
Aug 09 23:07:46 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e9ca8c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a8a92b-13b5-4858-9be8-1dd0f559736d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9555c8-5d5d-4292-8aff-559dbcaa6f7b]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a36fa38-86ba-4edf-b015-ff5e5c376759]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb554a5-7c25-4c3a-b18c-1144398626df]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d2ee37-500b-4c15-a459-57dfaca801ec]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c6351b-e156-4e97-8c10-bbfa2ffffb1f]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3, portal: 172.16.0.220,3260]
Aug 09 23:07:46 user nova-compute[72409]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3, portal: 172.16.0.220,3260] successful.
Aug 09 23:07:46 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e659217-08c1-4793-90f6-ec2ea0dc510c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] <== disconnect_volume: return (266ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:07:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lazy-loading 'flavor' on Instance uuid fbee7df5-5051-4064-bfa3-fa7a0da9c7aa {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9ce08fcf-d59f-43a9-bc3c-4389a3848073 tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.618s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.507s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:47 user nova-compute[72409]: INFO nova.compute.manager [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Terminating instance
Aug 09 23:07:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG nova.compute.manager [req-785e7432-5412-46a5-851a-de6018b39652 req-f4597879-6afa-465c-be2f-3481abf293ac service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Received event network-vif-unplugged-2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-785e7432-5412-46a5-851a-de6018b39652 req-f4597879-6afa-465c-be2f-3481abf293ac service nova] Acquiring lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-785e7432-5412-46a5-851a-de6018b39652 req-f4597879-6afa-465c-be2f-3481abf293ac service nova] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-785e7432-5412-46a5-851a-de6018b39652 req-f4597879-6afa-465c-be2f-3481abf293ac service nova] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG nova.compute.manager [req-785e7432-5412-46a5-851a-de6018b39652 req-f4597879-6afa-465c-be2f-3481abf293ac service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] No waiting events found dispatching network-vif-unplugged-2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:07:47 user nova-compute[72409]: DEBUG nova.compute.manager [req-785e7432-5412-46a5-851a-de6018b39652 req-f4597879-6afa-465c-be2f-3481abf293ac service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Received event network-vif-unplugged-2a923c01-b708-4bc5-ae85-88372217085c for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:07:48 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Instance destroyed successfully.
Aug 09 23:07:48 user nova-compute[72409]: DEBUG nova.objects.instance [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lazy-loading 'resources' on Instance uuid fbee7df5-5051-4064-bfa3-fa7a0da9c7aa {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1045314638',display_name='tempest-VolumesSnapshotTestJSON-instance-1045314638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1045314638',id=34,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoo/KhKR5krjgCLVSiyQgei9VpHIE+2c7lL9AVwr6Q3vxbBgGjcDFlpCu27XNF6XnQaxN3rT8PGF06Zbf9Rwt+UgjycuCM0Y+M05AjQczcPkLboJ3AmvvjXOLcfYafYMg==',key_name='tempest-keypair-692076178',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:05:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='302ec6e31abf4e89847c80adbb45be87',ramdisk_id='',reservation_id='r-k8i7dscd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-725320644',owner_user_name='tempest-VolumesSnapshotTestJSON-725320644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='539168ee5b36474680b3e9fc785a2237',uuid=fbee7df5-5051-4064-bfa3-fa7a0da9c7aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a923c01-b708-4bc5-ae85-88372217085c", "address": "fa:16:3e:36:7f:c2", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a923c01-b7", "ovs_interfaceid": "2a923c01-b708-4bc5-ae85-88372217085c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Converting VIF {"id": "2a923c01-b708-4bc5-ae85-88372217085c", "address": "fa:16:3e:36:7f:c2", "network": {"id": "313897ea-50fe-44ab-a487-eef5fe7d6fe1", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-195086798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302ec6e31abf4e89847c80adbb45be87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a923c01-b7", "ovs_interfaceid": "2a923c01-b708-4bc5-ae85-88372217085c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:7f:c2,bridge_name='br-int',has_traffic_filtering=True,id=2a923c01-b708-4bc5-ae85-88372217085c,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a923c01-b7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG os_vif [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:7f:c2,bridge_name='br-int',has_traffic_filtering=True,id=2a923c01-b708-4bc5-ae85-88372217085c,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a923c01-b7') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a923c01-b7, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:07:48 user nova-compute[72409]: INFO os_vif [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:7f:c2,bridge_name='br-int',has_traffic_filtering=True,id=2a923c01-b708-4bc5-ae85-88372217085c,network=Network(313897ea-50fe-44ab-a487-eef5fe7d6fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a923c01-b7')
Aug 09 23:07:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsmOXGRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:07:48 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:07:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b55f3840-94ca-4ec4-9f4e-ba4c44fa59a3', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b74df4f-017b-467c-ac3a-acb87656c93b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce62f780-e95a-444b-8246-1689d0534a57]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:07:48 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:07:48 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:07:48 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:07:48 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e9c2851b0>, {}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Disconnecting from: [] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.045s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] <== disconnect_volume: return (46ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:07:48 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Deleting instance files /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa_del
Aug 09 23:07:48 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Deletion of /opt/stack/data/nova/instances/fbee7df5-5051-4064-bfa3-fa7a0da9c7aa_del complete
Aug 09 23:07:48 user nova-compute[72409]: INFO nova.compute.manager [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 23:07:48 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:07:48 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-384ead39-006a-4ae3-ae88-2e1e23c9267b req-76bab0ed-0a09-4dfb-b35e-c91d375cd2ae service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Received event network-changed-39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-384ead39-006a-4ae3-ae88-2e1e23c9267b req-76bab0ed-0a09-4dfb-b35e-c91d375cd2ae service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Refreshing instance network info cache due to event network-changed-39a8aeb7-1217-485f-b885-82bed5f3b3ef. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-384ead39-006a-4ae3-ae88-2e1e23c9267b req-76bab0ed-0a09-4dfb-b35e-c91d375cd2ae service nova] Acquiring lock "refresh_cache-438a2af8-be2a-48cb-af65-7ad4e1259c56" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-384ead39-006a-4ae3-ae88-2e1e23c9267b req-76bab0ed-0a09-4dfb-b35e-c91d375cd2ae service nova] Acquired lock "refresh_cache-438a2af8-be2a-48cb-af65-7ad4e1259c56" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG nova.network.neutron [req-384ead39-006a-4ae3-ae88-2e1e23c9267b req-76bab0ed-0a09-4dfb-b35e-c91d375cd2ae service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Refreshing network info cache for port 39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:07:49 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Took 1.03 seconds to deallocate network for instance.
Aug 09 23:07:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-9e07e02d-56ff-4bef-ae53-60614ffc33a7 req-26aa531e-c399-470d-95d1-c805bf0ea38e service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Received event network-vif-deleted-2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:49 user nova-compute[72409]: WARNING nova.volume.cinder [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Attachment c2ebac5a-4afd-4062-97c2-6e5dd3a75018 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c2ebac5a-4afd-4062-97c2-6e5dd3a75018. (HTTP 404) (Request-ID: req-0e2ead12-e5d5-4456-a86d-60a7dd832232)
Aug 09 23:07:49 user nova-compute[72409]: INFO nova.compute.manager [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Took 0.03 seconds to detach 1 volumes for instance.
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-eb33be50-2dbc-4b11-8033-9ea22c4cb2bd req-0cfd4c5a-15d8-4e6e-a3a0-09ce58fd1b7c service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Received event network-vif-plugged-2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-eb33be50-2dbc-4b11-8033-9ea22c4cb2bd req-0cfd4c5a-15d8-4e6e-a3a0-09ce58fd1b7c service nova] Acquiring lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-eb33be50-2dbc-4b11-8033-9ea22c4cb2bd req-0cfd4c5a-15d8-4e6e-a3a0-09ce58fd1b7c service nova] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-eb33be50-2dbc-4b11-8033-9ea22c4cb2bd req-0cfd4c5a-15d8-4e6e-a3a0-09ce58fd1b7c service nova] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-eb33be50-2dbc-4b11-8033-9ea22c4cb2bd req-0cfd4c5a-15d8-4e6e-a3a0-09ce58fd1b7c service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] No waiting events found dispatching network-vif-plugged-2a923c01-b708-4bc5-ae85-88372217085c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:07:49 user nova-compute[72409]: WARNING nova.compute.manager [req-eb33be50-2dbc-4b11-8033-9ea22c4cb2bd req-0cfd4c5a-15d8-4e6e-a3a0-09ce58fd1b7c service nova] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Received unexpected event network-vif-plugged-2a923c01-b708-4bc5-ae85-88372217085c for instance with vm_state deleted and task_state None.
Aug 09 23:07:49 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:49 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Deleted allocations for instance fbee7df5-5051-4064-bfa3-fa7a0da9c7aa
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "438a2af8-be2a-48cb-af65-7ad4e1259c56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:50 user nova-compute[72409]: INFO nova.compute.manager [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Terminating instance
Aug 09 23:07:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-06ec4748-18a8-4c2e-9f4c-6ae19bb59d8d tempest-VolumesSnapshotTestJSON-725320644 tempest-VolumesSnapshotTestJSON-725320644-project-member] Lock "fbee7df5-5051-4064-bfa3-fa7a0da9c7aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.530s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG nova.network.neutron [req-384ead39-006a-4ae3-ae88-2e1e23c9267b req-76bab0ed-0a09-4dfb-b35e-c91d375cd2ae service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Updated VIF entry in instance network info cache for port 39a8aeb7-1217-485f-b885-82bed5f3b3ef. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG nova.network.neutron [req-384ead39-006a-4ae3-ae88-2e1e23c9267b req-76bab0ed-0a09-4dfb-b35e-c91d375cd2ae service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Updating instance_info_cache with network_info: [{"id": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "address": "fa:16:3e:f1:17:d5", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a8aeb7-12", "ovs_interfaceid": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-384ead39-006a-4ae3-ae88-2e1e23c9267b req-76bab0ed-0a09-4dfb-b35e-c91d375cd2ae service nova] Releasing lock "refresh_cache-438a2af8-be2a-48cb-af65-7ad4e1259c56" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:50 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Instance destroyed successfully.
Aug 09 23:07:50 user nova-compute[72409]: DEBUG nova.objects.instance [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lazy-loading 'resources' on Instance uuid 438a2af8-be2a-48cb-af65-7ad4e1259c56 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1576433463',display_name='tempest-TestVolumeBootPattern-server-1576433463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1576433463',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1aHN+hYxllL5tuB8HvAlIacEjfYF+w1msAbdktrPPHCcF11JPXwNiBeUP+wL/G+SHuINuvHbsNfaNGa+fgVIlRHvAF1ETChrpZfHrOyvh53hIFQ9t/gmToggpOGTMoMw==',key_name='tempest-TestVolumeBootPattern-982211312',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:06:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-292uo6yh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:06:13Z,user_data=None,user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=438a2af8-be2a-48cb-af65-7ad4e1259c56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "address": "fa:16:3e:f1:17:d5", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a8aeb7-12", "ovs_interfaceid": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "address": "fa:16:3e:f1:17:d5", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a8aeb7-12", "ovs_interfaceid": "39a8aeb7-1217-485f-b885-82bed5f3b3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:17:d5,bridge_name='br-int',has_traffic_filtering=True,id=39a8aeb7-1217-485f-b885-82bed5f3b3ef,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a8aeb7-12') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_vif [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:17:d5,bridge_name='br-int',has_traffic_filtering=True,id=39a8aeb7-1217-485f-b885-82bed5f3b3ef,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a8aeb7-12') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39a8aeb7-12, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:07:50 user nova-compute[72409]: INFO os_vif [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:17:d5,bridge_name='br-int',has_traffic_filtering=True,id=39a8aeb7-1217-485f-b885-82bed5f3b3ef,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a8aeb7-12')
Aug 09 23:07:50 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQBwOVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:07:50 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c94c7ae-c000-4f92-9b3a-900a16b1f1ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3a54b4-44fc-4645-bfe5-2bbeb4c2fbc6]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:07:50 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:07:50 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:07:50 user nova-compute[72409]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:07:50 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e843a7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a'): ({'sde'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Removing single pathed devices sde {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e7ea32-7852-43f7-97bd-78e3defa2b68]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2488b636-f0c4-4601-90f4-469c9366f7d3]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flushing IO for device /dev/sde {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[802219f2-a493-46be-8261-171213707c7f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54ff61c-74c6-4b91-a745-2d5fa99048a3]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOec60bbb4-6fdd4a3eaa6b3953', '/dev/disk/by-id/scsi-23666646434613365', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ec60bbb4') {{(pid=83250) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b09df4c-09b8-466c-bd18-b760a96c34d6]: (4, None) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:07:50 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff8011c-bd9b-49a7-9247-c66b45b8d0a9]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c512cd8-2473-4914-b700-ee0444fb06c2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260]
Aug 09 23:07:51 user nova-compute[72409]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260] successful.
Aug 09 23:07:51 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cc8acc-9e54-41f9-ba9d-1ce720329afc]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== disconnect_volume: return (293ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:07:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Deleting instance files /opt/stack/data/nova/instances/438a2af8-be2a-48cb-af65-7ad4e1259c56_del
Aug 09 23:07:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Deletion of /opt/stack/data/nova/instances/438a2af8-be2a-48cb-af65-7ad4e1259c56_del complete
Aug 09 23:07:51 user nova-compute[72409]: INFO nova.compute.manager [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-b7b4a493-0aa1-422a-862d-e58d5181ca43 req-16859d24-8748-401f-9069-7e8a05504fd8 service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Received event network-vif-unplugged-39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b7b4a493-0aa1-422a-862d-e58d5181ca43 req-16859d24-8748-401f-9069-7e8a05504fd8 service nova] Acquiring lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b7b4a493-0aa1-422a-862d-e58d5181ca43 req-16859d24-8748-401f-9069-7e8a05504fd8 service nova] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b7b4a493-0aa1-422a-862d-e58d5181ca43 req-16859d24-8748-401f-9069-7e8a05504fd8 service nova] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-b7b4a493-0aa1-422a-862d-e58d5181ca43 req-16859d24-8748-401f-9069-7e8a05504fd8 service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] No waiting events found dispatching network-vif-unplugged-39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-b7b4a493-0aa1-422a-862d-e58d5181ca43 req-16859d24-8748-401f-9069-7e8a05504fd8 service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Received event network-vif-unplugged-39a8aeb7-1217-485f-b885-82bed5f3b3ef for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-b7b4a493-0aa1-422a-862d-e58d5181ca43 req-16859d24-8748-401f-9069-7e8a05504fd8 service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Received event network-vif-plugged-39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b7b4a493-0aa1-422a-862d-e58d5181ca43 req-16859d24-8748-401f-9069-7e8a05504fd8 service nova] Acquiring lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b7b4a493-0aa1-422a-862d-e58d5181ca43 req-16859d24-8748-401f-9069-7e8a05504fd8 service nova] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b7b4a493-0aa1-422a-862d-e58d5181ca43 req-16859d24-8748-401f-9069-7e8a05504fd8 service nova] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-b7b4a493-0aa1-422a-862d-e58d5181ca43 req-16859d24-8748-401f-9069-7e8a05504fd8 service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] No waiting events found dispatching network-vif-plugged-39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:07:51 user nova-compute[72409]: WARNING nova.compute.manager [req-b7b4a493-0aa1-422a-862d-e58d5181ca43 req-16859d24-8748-401f-9069-7e8a05504fd8 service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Received unexpected event network-vif-plugged-39a8aeb7-1217-485f-b885-82bed5f3b3ef for instance with vm_state active and task_state deleting.
Aug 09 23:07:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:52 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:07:52 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Took 0.97 seconds to deallocate network for instance.
Aug 09 23:07:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-397deaa8-941c-43be-99d1-4fc3c8147fc8 req-68ebb987-c463-4088-b7c2-d9c37623ef95 service nova] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Received event network-vif-deleted-39a8aeb7-1217-485f-b885-82bed5f3b3ef {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:07:52 user nova-compute[72409]: INFO nova.compute.manager [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Took 0.74 seconds to detach 1 volumes for instance.
Aug 09 23:07:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:07:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:07:53 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:07:53 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:07:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:53 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Deleted allocations for instance 438a2af8-be2a-48cb-af65-7ad4e1259c56
Aug 09 23:07:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-282b3cc8-a6ca-44a6-a4e3-ae28303a51fe tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "438a2af8-be2a-48cb-af65-7ad4e1259c56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.290s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:07:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:07:59 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:08:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:00 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:08:00 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:08:03 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622468.244122, fbee7df5-5051-4064-bfa3-fa7a0da9c7aa => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:08:03 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] VM Stopped (Lifecycle Event)
Aug 09 23:08:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-79056971-ef53-4e50-9df4-3c7ff94021a7 None None] [instance: fbee7df5-5051-4064-bfa3-fa7a0da9c7aa] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:08:03 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:08:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:03 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622470.7677896, 438a2af8-be2a-48cb-af65-7ad4e1259c56 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:08:05 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] VM Stopped (Lifecycle Event)
Aug 09 23:08:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-bb5695b0-c2fe-4862-8c75-dc2cdb808bec None None] [instance: 438a2af8-be2a-48cb-af65-7ad4e1259c56] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:06 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:08:06 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7651MB free_disk=25.277732849121094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c0f72ca0-06ef-444d-97d4-fca49bdde831 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance b0c67c33-9d1a-4479-a64f-8f867330b9dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a75a5458-8710-425d-9755-dc2dc71f7d5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:08:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:07 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:08:07 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:08:07 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:08:07 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:08:07 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:08:08 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:08:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:08:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:08:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:08:08 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:08:09 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updating instance_info_cache with network_info: [{"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:08:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:08:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:08:09 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:08:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:08:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:08:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:08:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:08:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:08:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:08:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:29 user nova-compute[72409]: INFO nova.compute.manager [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Terminating instance
Aug 09 23:08:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:08:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-9f9fac72-1395-4b4c-b513-c5cc120afebc req-9fc8c5b6-8580-431d-80bf-ce3b7aa7034b service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-vif-unplugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9f9fac72-1395-4b4c-b513-c5cc120afebc req-9fc8c5b6-8580-431d-80bf-ce3b7aa7034b service nova] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9f9fac72-1395-4b4c-b513-c5cc120afebc req-9fc8c5b6-8580-431d-80bf-ce3b7aa7034b service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9f9fac72-1395-4b4c-b513-c5cc120afebc req-9fc8c5b6-8580-431d-80bf-ce3b7aa7034b service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-9f9fac72-1395-4b4c-b513-c5cc120afebc req-9fc8c5b6-8580-431d-80bf-ce3b7aa7034b service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] No waiting events found dispatching network-vif-unplugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-9f9fac72-1395-4b4c-b513-c5cc120afebc req-9fc8c5b6-8580-431d-80bf-ce3b7aa7034b service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-vif-unplugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:08:30 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Instance destroyed successfully.
Aug 09 23:08:30 user nova-compute[72409]: DEBUG nova.objects.instance [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lazy-loading 'resources' on Instance uuid c0f72ca0-06ef-444d-97d4-fca49bdde831 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-186357607',display_name='tempest-TestMinimumBasicScenario-server-186357607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-186357607',id=33,image_ref='5013c52b-967c-437e-9a94-0012dc27ed46',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFAR9IZB44DUyQYnxREnvvPQDdAJL8Rdwdh+Np3EcAGSsHf/h/KcsbHOE/uu430JCssRE9LJKDGK6dXZA0O4kVoiXAuAd/wWJMICmgROsbu9A3I5eSVsjj+WOvLe7aQww==',key_name='tempest-TestMinimumBasicScenario-1640560775',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:03:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fb0e0790757422da3f43722e4bd554e',ramdisk_id='',reservation_id='r-wch0bk8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5013c52b-967c-437e-9a94-0012dc27ed46',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1632899528',owner_user_name='tempest-TestMinimumBasicScenario-1632899528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:05:49Z,user_data=None,user_id='8411ad4a2fdd412783da8516d860cccb',uuid=c0f72ca0-06ef-444d-97d4-fca49bdde831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converting VIF {"id": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "address": "fa:16:3e:03:7b:bf", "network": {"id": "2dae3084-83dc-48ae-b73b-6691ef66b9e6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-852822541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0e0790757422da3f43722e4bd554e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72040fc9-f3", "ovs_interfaceid": "72040fc9-f3df-43df-a3e4-c5ba8c410187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=72040fc9-f3df-43df-a3e4-c5ba8c410187,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72040fc9-f3') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG os_vif [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=72040fc9-f3df-43df-a3e4-c5ba8c410187,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72040fc9-f3') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72040fc9-f3, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:08:30 user nova-compute[72409]: INFO os_vif [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=72040fc9-f3df-43df-a3e4-c5ba8c410187,network=Network(2dae3084-83dc-48ae-b73b-6691ef66b9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72040fc9-f3')
Aug 09 23:08:30 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Deleting instance files /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831_del
Aug 09 23:08:30 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Deletion of /opt/stack/data/nova/instances/c0f72ca0-06ef-444d-97d4-fca49bdde831_del complete
Aug 09 23:08:30 user nova-compute[72409]: INFO nova.compute.manager [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 23:08:30 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:08:30 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:08:31 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:08:31 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Took 0.53 seconds to deallocate network for instance.
Aug 09 23:08:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-6568f2cf-bd2e-48ca-9781-6e84d1eba249 req-ee789d17-e571-4f71-aa1c-7a2aa5eb06aa service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-vif-deleted-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:08:31 user nova-compute[72409]: INFO nova.compute.manager [req-6568f2cf-bd2e-48ca-9781-6e84d1eba249 req-ee789d17-e571-4f71-aa1c-7a2aa5eb06aa service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Neutron deleted interface 72040fc9-f3df-43df-a3e4-c5ba8c410187; detaching it from the instance and deleting it from the info cache
Aug 09 23:08:31 user nova-compute[72409]: DEBUG nova.network.neutron [req-6568f2cf-bd2e-48ca-9781-6e84d1eba249 req-ee789d17-e571-4f71-aa1c-7a2aa5eb06aa service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:08:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-6568f2cf-bd2e-48ca-9781-6e84d1eba249 req-ee789d17-e571-4f71-aa1c-7a2aa5eb06aa service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Detach interface failed, port_id=72040fc9-f3df-43df-a3e4-c5ba8c410187, reason: Instance c0f72ca0-06ef-444d-97d4-fca49bdde831 could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 23:08:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:31 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:08:31 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:08:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:31 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Deleted allocations for instance c0f72ca0-06ef-444d-97d4-fca49bdde831
Aug 09 23:08:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f7115e03-b796-4948-9a40-d8f2d331acba tempest-TestMinimumBasicScenario-1632899528 tempest-TestMinimumBasicScenario-1632899528-project-member] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.791s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-90ecd4b5-5500-4eac-ad47-24e25ee27186 req-67e0ccc5-a404-4901-8596-c9d40277751e service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received event network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:08:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-90ecd4b5-5500-4eac-ad47-24e25ee27186 req-67e0ccc5-a404-4901-8596-c9d40277751e service nova] Acquiring lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-90ecd4b5-5500-4eac-ad47-24e25ee27186 req-67e0ccc5-a404-4901-8596-c9d40277751e service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-90ecd4b5-5500-4eac-ad47-24e25ee27186 req-67e0ccc5-a404-4901-8596-c9d40277751e service nova] Lock "c0f72ca0-06ef-444d-97d4-fca49bdde831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-90ecd4b5-5500-4eac-ad47-24e25ee27186 req-67e0ccc5-a404-4901-8596-c9d40277751e service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] No waiting events found dispatching network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:08:32 user nova-compute[72409]: WARNING nova.compute.manager [req-90ecd4b5-5500-4eac-ad47-24e25ee27186 req-67e0ccc5-a404-4901-8596-c9d40277751e service nova] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Received unexpected event network-vif-plugged-72040fc9-f3df-43df-a3e4-c5ba8c410187 for instance with vm_state deleted and task_state None.
Aug 09 23:08:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-95384816-def0-4ce0-b0e9-52062fba8531 req-b589720c-6901-4961-b819-ee4fd685c95a service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Received event network-changed-c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:08:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-95384816-def0-4ce0-b0e9-52062fba8531 req-b589720c-6901-4961-b819-ee4fd685c95a service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Refreshing instance network info cache due to event network-changed-c463ae05-66b4-4234-8fdb-7f449078b8e6. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:08:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-95384816-def0-4ce0-b0e9-52062fba8531 req-b589720c-6901-4961-b819-ee4fd685c95a service nova] Acquiring lock "refresh_cache-e870efcb-fcb2-4dda-b92a-538fd06f16a7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:08:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-95384816-def0-4ce0-b0e9-52062fba8531 req-b589720c-6901-4961-b819-ee4fd685c95a service nova] Acquired lock "refresh_cache-e870efcb-fcb2-4dda-b92a-538fd06f16a7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:08:41 user nova-compute[72409]: DEBUG nova.network.neutron [req-95384816-def0-4ce0-b0e9-52062fba8531 req-b589720c-6901-4961-b819-ee4fd685c95a service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Refreshing network info cache for port c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:08:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:42 user nova-compute[72409]: DEBUG nova.network.neutron [req-95384816-def0-4ce0-b0e9-52062fba8531 req-b589720c-6901-4961-b819-ee4fd685c95a service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Updated VIF entry in instance network info cache for port c463ae05-66b4-4234-8fdb-7f449078b8e6. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:08:42 user nova-compute[72409]: DEBUG nova.network.neutron [req-95384816-def0-4ce0-b0e9-52062fba8531 req-b589720c-6901-4961-b819-ee4fd685c95a service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Updating instance_info_cache with network_info: [{"id": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "address": "fa:16:3e:1e:a5:0b", "network": {"id": "a77ce7e5-f19c-4182-b6b9-52bdbd861868", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-539340574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28055127bfa44a1e8a8c2b79fae46838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc463ae05-66", "ovs_interfaceid": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:08:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-95384816-def0-4ce0-b0e9-52062fba8531 req-b589720c-6901-4961-b819-ee4fd685c95a service nova] Releasing lock "refresh_cache-e870efcb-fcb2-4dda-b92a-538fd06f16a7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:08:43 user nova-compute[72409]: INFO nova.compute.manager [None req-ef85bf44-c84a-49fe-b490-8e6dc3a96931 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Get console output
Aug 09 23:08:43 user nova-compute[72409]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 09 23:08:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "a97303da-cb91-40b9-a7bc-c674365a482e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "a97303da-cb91-40b9-a7bc-c674365a482e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:43 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:08:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:43 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:08:43 user nova-compute[72409]: INFO nova.compute.claims [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Claim successful on node user
Aug 09 23:08:43 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:08:43 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:08:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:43 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:08:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:08:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG nova.policy [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd5e2f13e0a448e836dd8684b889a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d29522bd16460eb1edc9fb7918111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:08:44 user nova-compute[72409]: INFO nova.virt.block_device [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Booting with volume 4ad73b76-b30a-4219-ac4c-7c96747e462a at /dev/vda
Aug 09 23:08:44 user nova-compute[72409]: DEBUG os_brick.utils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[94433777-b423-405a-a8f6-a037831ba9e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c228e3bf-864c-4510-ac5f-0aeb26f5ecbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d1b70b-b70e-400f-a780-6462a88436e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a075ac-fc0c-4b6c-bb47-6e4818ac59ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:08:44 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:08:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8edc6ea-1a2e-4ab2-9949-198300c8de7c]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG os_brick.utils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Updating existing volume attachment record: e2509455-8df7-40e0-b4cb-bd5db709e131 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:08:44 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Successfully created port: 88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:08:45 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622510.4669394, c0f72ca0-06ef-444d-97d4-fca49bdde831 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:08:45 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] VM Stopped (Lifecycle Event)
Aug 09 23:08:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-5eb2f658-0a74-4165-a8db-42715838d0d5 None None] [instance: c0f72ca0-06ef-444d-97d4-fca49bdde831] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:08:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:45 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Successfully updated port: 88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:08:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "refresh_cache-a97303da-cb91-40b9-a7bc-c674365a482e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:08:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquired lock "refresh_cache-a97303da-cb91-40b9-a7bc-c674365a482e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:08:45 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:08:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-1d114519-ab53-4537-917a-f97367aa0289 req-5c84740d-f565-4606-b3f8-f9179c30a4ad service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Received event network-changed-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:08:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-1d114519-ab53-4537-917a-f97367aa0289 req-5c84740d-f565-4606-b3f8-f9179c30a4ad service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Refreshing instance network info cache due to event network-changed-88c8db8a-4d24-48f5-b62e-03b2eb95ba33. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:08:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1d114519-ab53-4537-917a-f97367aa0289 req-5c84740d-f565-4606-b3f8-f9179c30a4ad service nova] Acquiring lock "refresh_cache-a97303da-cb91-40b9-a7bc-c674365a482e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG nova.network.neutron [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Updating instance_info_cache with network_info: [{"id": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "address": "fa:16:3e:8c:ea:41", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8db8a-4d", "ovs_interfaceid": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Releasing lock "refresh_cache-a97303da-cb91-40b9-a7bc-c674365a482e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Instance network_info: |[{"id": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "address": "fa:16:3e:8c:ea:41", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8db8a-4d", "ovs_interfaceid": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1d114519-ab53-4537-917a-f97367aa0289 req-5c84740d-f565-4606-b3f8-f9179c30a4ad service nova] Acquired lock "refresh_cache-a97303da-cb91-40b9-a7bc-c674365a482e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG nova.network.neutron [req-1d114519-ab53-4537-917a-f97367aa0289 req-5c84740d-f565-4606-b3f8-f9179c30a4ad service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Refreshing network info cache for port 88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'flavor' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:46 user nova-compute[72409]: INFO nova.compute.manager [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attaching volume deac1c6a-1845-4f3d-8ece-7cdc436af13d to /dev/vdb
Aug 09 23:08:46 user nova-compute[72409]: DEBUG os_brick.utils [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG nova.network.neutron [req-1d114519-ab53-4537-917a-f97367aa0289 req-5c84740d-f565-4606-b3f8-f9179c30a4ad service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Updated VIF entry in instance network info cache for port 88c8db8a-4d24-48f5-b62e-03b2eb95ba33. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG nova.network.neutron [req-1d114519-ab53-4537-917a-f97367aa0289 req-5c84740d-f565-4606-b3f8-f9179c30a4ad service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Updating instance_info_cache with network_info: [{"id": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "address": "fa:16:3e:8c:ea:41", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8db8a-4d", "ovs_interfaceid": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95a8c58-c6d1-4e85-b1ca-ce03473beec1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1d114519-ab53-4537-917a-f97367aa0289 req-5c84740d-f565-4606-b3f8-f9179c30a4ad service nova] Releasing lock "refresh_cache-a97303da-cb91-40b9-a7bc-c674365a482e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9876586-2705-4738-9577-a2150c640efe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3455acb0-a37c-416e-8f8a-e48848cae969]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7273472c-06a8-4e15-bfa6-fa64ff6f74ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:08:46 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:08:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[143807ab-cdd0-48c4-a6ca-80bae2a88127]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG os_brick.utils [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Updating existing volume attachment record: 49ca440a-179e-4bee-ada4-3b3a75baddef {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:08:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:08:53 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Creating image(s)
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Ensure instance console log exists: /opt/stack/data/nova/instances/a97303da-cb91-40b9-a7bc-c674365a482e/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Start _get_guest_xml network_info=[{"id": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "address": "fa:16:3e:8c:ea:41", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8db8a-4d", "ovs_interfaceid": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQBwOVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a97303da-cb91-40b9-a7bc-c674365a482e', 'attached_at': '', 'detached_at': '', 'volume_id': '4ad73b76-b30a-4219-ac4c-7c96747e462a', 'serial': '4ad73b76-b30a-4219-ac4c-7c96747e462a'}, 'mount_device': '/dev/vda', 'attachment_id': 'e2509455-8df7-40e0-b4cb-bd5db709e131', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:08:53 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:08:53 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQBwOVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:08:53 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:08:53 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:08:53 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff51d5f-912b-42bc-8206-1361d13a9314]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:08:53 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6730811c-9501-4ca7-99f5-2451e98891c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a] added
Aug 09 23:08:53 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4364504-913d-4fc0-bed3-54b4fedc5a0d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b0c22a-b473-4df5-ad71-1f3cd0f48f9c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQBwOVRZ {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQBwOVRZ" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff89d1f-9002-4512-b1e2-a170b6c4712b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WQBwOVRZ'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf9143-b0f9-47ee-8322-efc37dbf41aa]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ebe3a4-5a61-4053-94c6-21fa132fe191]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:08:53 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:08:53 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[283d365d-b231-414e-b4fc-ce52975b637e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260]
Aug 09 23:08:53 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260] successful.
Aug 09 23:08:53 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ae598a-8a51-4b94-a679-ac69cc291365]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b835681-ced5-488c-a324-31b9fd3597f3]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:08:53 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:08:53 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:08:53 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:08:53 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7e5db7-d46b-4518-9efd-366ac39ce1bf]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:08:53 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQBwOVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23666646434613365', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666646434613365', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-74785377',display_name='tempest-TestVolumeBootPattern-server-74785377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-74785377',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1aHN+hYxllL5tuB8HvAlIacEjfYF+w1msAbdktrPPHCcF11JPXwNiBeUP+wL/G+SHuINuvHbsNfaNGa+fgVIlRHvAF1ETChrpZfHrOyvh53hIFQ9t/gmToggpOGTMoMw==',key_name='tempest-TestVolumeBootPattern-982211312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-0oulejdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:08:44Z,user_data=None,user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=a97303da-cb91-40b9-a7bc-c674365a482e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "address": "fa:16:3e:8c:ea:41", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8db8a-4d", "ovs_interfaceid": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "address": "fa:16:3e:8c:ea:41", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8db8a-4d", "ovs_interfaceid": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=88c8db8a-4d24-48f5-b62e-03b2eb95ba33,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8db8a-4d') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG nova.objects.instance [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lazy-loading 'pci_devices' on Instance uuid a97303da-cb91-40b9-a7bc-c674365a482e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:08:54 user nova-compute[72409]:   <uuid>a97303da-cb91-40b9-a7bc-c674365a482e</uuid>
Aug 09 23:08:54 user nova-compute[72409]:   <name>instance-00000028</name>
Aug 09 23:08:54 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:08:54 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:08:54 user nova-compute[72409]:   <metadata>
Aug 09 23:08:54 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:08:54 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:08:54 user nova-compute[72409]:       <nova:name>tempest-TestVolumeBootPattern-server-74785377</nova:name>
Aug 09 23:08:54 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:08:53</nova:creationTime>
Aug 09 23:08:54 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:08:54 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:08:54 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:08:54 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:08:54 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:08:54 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:08:54 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:08:54 user nova-compute[72409]:       <nova:owner>
Aug 09 23:08:54 user nova-compute[72409]:         <nova:user uuid="bcd5e2f13e0a448e836dd8684b889a70">tempest-TestVolumeBootPattern-431608932-project-member</nova:user>
Aug 09 23:08:54 user nova-compute[72409]:         <nova:project uuid="b6d29522bd16460eb1edc9fb7918111f">tempest-TestVolumeBootPattern-431608932</nova:project>
Aug 09 23:08:54 user nova-compute[72409]:       </nova:owner>
Aug 09 23:08:54 user nova-compute[72409]:       <nova:ports>
Aug 09 23:08:54 user nova-compute[72409]:         <nova:port uuid="88c8db8a-4d24-48f5-b62e-03b2eb95ba33">
Aug 09 23:08:54 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 23:08:54 user nova-compute[72409]:         </nova:port>
Aug 09 23:08:54 user nova-compute[72409]:       </nova:ports>
Aug 09 23:08:54 user nova-compute[72409]:     </nova:instance>
Aug 09 23:08:54 user nova-compute[72409]:   </metadata>
Aug 09 23:08:54 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:08:54 user nova-compute[72409]:     <system>
Aug 09 23:08:54 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:08:54 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:08:54 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:08:54 user nova-compute[72409]:       <entry name="serial">a97303da-cb91-40b9-a7bc-c674365a482e</entry>
Aug 09 23:08:54 user nova-compute[72409]:       <entry name="uuid">a97303da-cb91-40b9-a7bc-c674365a482e</entry>
Aug 09 23:08:54 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:08:54 user nova-compute[72409]:     </system>
Aug 09 23:08:54 user nova-compute[72409]:   </sysinfo>
Aug 09 23:08:54 user nova-compute[72409]:   <os>
Aug 09 23:08:54 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:08:54 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:08:54 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:08:54 user nova-compute[72409]:   </os>
Aug 09 23:08:54 user nova-compute[72409]:   <features>
Aug 09 23:08:54 user nova-compute[72409]:     <acpi/>
Aug 09 23:08:54 user nova-compute[72409]:     <apic/>
Aug 09 23:08:54 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:08:54 user nova-compute[72409]:   </features>
Aug 09 23:08:54 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:08:54 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:08:54 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:08:54 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:08:54 user nova-compute[72409]:   </clock>
Aug 09 23:08:54 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:08:54 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:08:54 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:08:54 user nova-compute[72409]:   </cpu>
Aug 09 23:08:54 user nova-compute[72409]:   <devices>
Aug 09 23:08:54 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 23:08:54 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:08:54 user nova-compute[72409]:       <source dev="/dev/sdb"/>
Aug 09 23:08:54 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:08:54 user nova-compute[72409]:       <serial>4ad73b76-b30a-4219-ac4c-7c96747e462a</serial>
Aug 09 23:08:54 user nova-compute[72409]:     </disk>
Aug 09 23:08:54 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:08:54 user nova-compute[72409]:       <mac address="fa:16:3e:8c:ea:41"/>
Aug 09 23:08:54 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:08:54 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:08:54 user nova-compute[72409]:       <target dev="tap88c8db8a-4d"/>
Aug 09 23:08:54 user nova-compute[72409]:     </interface>
Aug 09 23:08:54 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:08:54 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/a97303da-cb91-40b9-a7bc-c674365a482e/console.log" append="off"/>
Aug 09 23:08:54 user nova-compute[72409]:     </serial>
Aug 09 23:08:54 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:08:54 user nova-compute[72409]:     <video>
Aug 09 23:08:54 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:08:54 user nova-compute[72409]:     </video>
Aug 09 23:08:54 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:08:54 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:08:54 user nova-compute[72409]:     </rng>
Aug 09 23:08:54 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:08:54 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:08:54 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:08:54 user nova-compute[72409]:     </memballoon>
Aug 09 23:08:54 user nova-compute[72409]:   </devices>
Aug 09 23:08:54 user nova-compute[72409]: </domain>
Aug 09 23:08:54 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-74785377',display_name='tempest-TestVolumeBootPattern-server-74785377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-74785377',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1aHN+hYxllL5tuB8HvAlIacEjfYF+w1msAbdktrPPHCcF11JPXwNiBeUP+wL/G+SHuINuvHbsNfaNGa+fgVIlRHvAF1ETChrpZfHrOyvh53hIFQ9t/gmToggpOGTMoMw==',key_name='tempest-TestVolumeBootPattern-982211312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-0oulejdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:08:44Z,user_data=None,user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=a97303da-cb91-40b9-a7bc-c674365a482e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "address": "fa:16:3e:8c:ea:41", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8db8a-4d", "ovs_interfaceid": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "address": "fa:16:3e:8c:ea:41", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8db8a-4d", "ovs_interfaceid": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=88c8db8a-4d24-48f5-b62e-03b2eb95ba33,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8db8a-4d') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG os_vif [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=88c8db8a-4d24-48f5-b62e-03b2eb95ba33,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8db8a-4d') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88c8db8a-4d, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88c8db8a-4d, col_values=(('external_ids', {'iface-id': '88c8db8a-4d24-48f5-b62e-03b2eb95ba33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:ea:41', 'vm-uuid': 'a97303da-cb91-40b9-a7bc-c674365a482e'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:54 user nova-compute[72409]: INFO os_vif [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=88c8db8a-4d24-48f5-b62e-03b2eb95ba33,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8db8a-4d')
Aug 09 23:08:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:08:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] No VIF found with MAC fa:16:3e:8c:ea:41, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZaTsUcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:08:55 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:08:55 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:08:55 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8018786b-8729-479d-bee7-839589afc6c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:08:55 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cffff1b-011d-4d3b-b0d0-f49659058568]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d] added
Aug 09 23:08:55 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda509fb-8533-470f-9b2f-749e0f639175]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f4270c-54aa-49d3-afc2-1d92744963b0]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZaTsUcD {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZaTsUcD" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea3f542-930a-4580-b075-f765054e1e15]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xZaTsUcD'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb6f1aa-563d-4768-ae82-73e5ff117e93]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c709d189-2132-48c3-b039-8bbedaa1f6c8]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:08:55 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:08:55 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:08:55 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:08:55 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:08:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a80b343-0a0b-49d9-9e9c-58a45542f9fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d, portal: 172.16.0.220,3260]
Aug 09 23:08:56 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d, portal: 172.16.0.220,3260] successful.
Aug 09 23:08:56 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f065c40-72f7-4b7b-a0b6-9e7e8f92d61b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf81caa-c93a-4ba3-a190-da2347abadca]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:08:56 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:08:56 user nova-compute[72409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)
Aug 09 23:08:56 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:08:56 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:08:56 user nova-compute[72409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)
Aug 09 23:08:56 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f798cdc-edde-42aa-b23b-aa2c35ba4b1d]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZaTsUcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG nova.objects.instance [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'flavor' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-07002b76-32cf-40cd-9cd5-d6f6a871f927 req-3e6ee90a-78a1-4dbc-8995-70a3b5066843 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Received event network-vif-plugged-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-07002b76-32cf-40cd-9cd5-d6f6a871f927 req-3e6ee90a-78a1-4dbc-8995-70a3b5066843 service nova] Acquiring lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-07002b76-32cf-40cd-9cd5-d6f6a871f927 req-3e6ee90a-78a1-4dbc-8995-70a3b5066843 service nova] Lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-07002b76-32cf-40cd-9cd5-d6f6a871f927 req-3e6ee90a-78a1-4dbc-8995-70a3b5066843 service nova] Lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-07002b76-32cf-40cd-9cd5-d6f6a871f927 req-3e6ee90a-78a1-4dbc-8995-70a3b5066843 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] No waiting events found dispatching network-vif-plugged-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:08:56 user nova-compute[72409]: WARNING nova.compute.manager [req-07002b76-32cf-40cd-9cd5-d6f6a871f927 req-3e6ee90a-78a1-4dbc-8995-70a3b5066843 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Received unexpected event network-vif-plugged-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 for instance with vm_state building and task_state spawning.
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:56 user nova-compute[72409]: INFO nova.compute.manager [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Attaching volume 114ce0a8-4337-4129-aadf-6f0cf20af81a to /dev/vdb
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.utils [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f07630a-791c-4e21-ae2d-80d28ff137da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f0868d-2ec6-456f-8d60-203c17313bc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f75c433-0ed2-41c7-a107-8224c51e384b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcf44e7-e44a-4569-a277-169d96c6f435]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:08:56 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:08:56 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[61526dc7-becf-4e96-b3dc-909750c45351]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG os_brick.utils [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updating existing volume attachment record: d404e4f2-57f7-486e-adbd-2942fab0ba18 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:08:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:08:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26430643835303662', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:08:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430643835303662', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:08:57 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'flavor' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:08:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:08:57 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:08:57 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:08:57 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:08:57 user nova-compute[72409]:   <serial>deac1c6a-1845-4f3d-8ece-7cdc436af13d</serial>
Aug 09 23:08:57 user nova-compute[72409]: </disk>
Aug 09 23:08:57 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:08:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:08:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:08:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No VIF found with MAC fa:16:3e:1e:a5:0b, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:08:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b0300675-92e1-45d2-842d-be11ab109f4d tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.042s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622538.3133292, a97303da-cb91-40b9-a7bc-c674365a482e => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:08:58 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] VM Resumed (Lifecycle Event)
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:08:58 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Instance spawned successfully.
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:08:58 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622538.3165798, a97303da-cb91-40b9-a7bc-c674365a482e => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:08:58 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] VM Started (Lifecycle Event)
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.compute.manager [req-b9485bd9-10cd-456c-b6b0-dc4b78eb2a93 req-5ab4d7c5-620d-431f-9fd2-54b40618fc73 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Received event network-vif-plugged-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b9485bd9-10cd-456c-b6b0-dc4b78eb2a93 req-5ab4d7c5-620d-431f-9fd2-54b40618fc73 service nova] Acquiring lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b9485bd9-10cd-456c-b6b0-dc4b78eb2a93 req-5ab4d7c5-620d-431f-9fd2-54b40618fc73 service nova] Lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b9485bd9-10cd-456c-b6b0-dc4b78eb2a93 req-5ab4d7c5-620d-431f-9fd2-54b40618fc73 service nova] Lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.compute.manager [req-b9485bd9-10cd-456c-b6b0-dc4b78eb2a93 req-5ab4d7c5-620d-431f-9fd2-54b40618fc73 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] No waiting events found dispatching network-vif-plugged-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:08:58 user nova-compute[72409]: WARNING nova.compute.manager [req-b9485bd9-10cd-456c-b6b0-dc4b78eb2a93 req-5ab4d7c5-620d-431f-9fd2-54b40618fc73 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Received unexpected event network-vif-plugged-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 for instance with vm_state building and task_state spawning.
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:08:58 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:08:58 user nova-compute[72409]: INFO nova.compute.manager [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Took 5.14 seconds to spawn the instance on the hypervisor.
Aug 09 23:08:58 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:08:58 user nova-compute[72409]: INFO nova.compute.manager [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Took 15.04 seconds to build instance.
Aug 09 23:08:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4cfff783-969d-483a-a123-eba8711c5881 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "a97303da-cb91-40b9-a7bc-c674365a482e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.146s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:08:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:01 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:09:01 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:09:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:09:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:09:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:05 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkfbvMVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:09:06 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:09:06 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:09:06 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a6ed78-dafd-4a74-915c-f9c3c5aa7c6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:09:06 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7e2096-6367-49cd-8b73-59702c95c5cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a] added
Aug 09 23:09:06 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9501b575-336a-459b-a71f-bc617b770f4c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fa4d2c-d53f-4b0e-b824-c16c696f2620]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkfbvMVy {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkfbvMVy" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9cd615-a34b-4e16-a099-ba611ac0eb51]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkfbvMVy'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdca8b3-f47b-4e23-89bf-645b893d9802]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[017fa87c-e002-49f7-8847-9d2cfcd44b4c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:09:06 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:09:06 user nova-compute[72409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)
Aug 09 23:09:06 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:09:06 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:09:06 user nova-compute[72409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)
Aug 09 23:09:06 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ab488a-0cd2-4cff-9fcf-1a72df76668e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a, portal: 172.16.0.220,3260]
Aug 09 23:09:06 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a, portal: 172.16.0.220,3260] successful.
Aug 09 23:09:06 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb1e4e6-cdb8-4f19-a059-99a283de3af6]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[664310b9-7057-4f97-9ecd-f81ff4f4a1f4]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:09:06 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:09:06 user nova-compute[72409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)
Aug 09 23:09:06 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:09:06 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:09:06 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:09:06 user nova-compute[72409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)
Aug 09 23:09:06 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:09:06 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.029s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[82518ddc-c543-4897-8ff6-83c967f37c77]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkfbvMVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23538313433333339', 'path': '/dev/sde'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538313433333339', 'path': '/dev/sde'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG nova.objects.instance [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'flavor' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:09:07 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:09:07 user nova-compute[72409]:   <source dev="/dev/sde"/>
Aug 09 23:09:07 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:09:07 user nova-compute[72409]:   <serial>114ce0a8-4337-4129-aadf-6f0cf20af81a</serial>
Aug 09 23:09:07 user nova-compute[72409]: </disk>
Aug 09 23:09:07 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:09:08 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:09:08 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7913MB free_disk=25.302684783935547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] No VIF found with MAC fa:16:3e:15:28:f7, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance b0c67c33-9d1a-4479-a64f-8f867330b9dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a75a5458-8710-425d-9755-dc2dc71f7d5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a97303da-cb91-40b9-a7bc-c674365a482e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0c470692-f07b-415f-8bb7-cba77459689a tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.008s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:09:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:09:09 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:09:10 user nova-compute[72409]: INFO nova.compute.manager [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Rescuing
Aug 09 23:09:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquired lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updating instance_info_cache with network_info: [{"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-3f216945-199d-4047-8bc8-407d5842c536" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updating instance_info_cache with network_info: [{"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Releasing lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-62c62070-9104-40f9-aa18-1bff63d6d7ed req-e1caff15-af6e-499e-98b6-8bbff12a4a11 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-unplugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:09:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-62c62070-9104-40f9-aa18-1bff63d6d7ed req-e1caff15-af6e-499e-98b6-8bbff12a4a11 service nova] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-62c62070-9104-40f9-aa18-1bff63d6d7ed req-e1caff15-af6e-499e-98b6-8bbff12a4a11 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-62c62070-9104-40f9-aa18-1bff63d6d7ed req-e1caff15-af6e-499e-98b6-8bbff12a4a11 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-62c62070-9104-40f9-aa18-1bff63d6d7ed req-e1caff15-af6e-499e-98b6-8bbff12a4a11 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] No waiting events found dispatching network-vif-unplugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:09:11 user nova-compute[72409]: WARNING nova.compute.manager [req-62c62070-9104-40f9-aa18-1bff63d6d7ed req-e1caff15-af6e-499e-98b6-8bbff12a4a11 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received unexpected event network-vif-unplugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 for instance with vm_state active and task_state rescuing.
Aug 09 23:09:11 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Instance destroyed successfully.
Aug 09 23:09:11 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Attempting a stable device rescue
Aug 09 23:09:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72409) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 23:09:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Instance directory exists: not creating {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 23:09:11 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Creating image(s)
Aug 09 23:09:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "/opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "/opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "/opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:11 user nova-compute[72409]: DEBUG nova.objects.instance [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'trusted_certs' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:09:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "8123f34a0823bcf017f41195ac4d44ccb2c515ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "8123f34a0823bcf017f41195ac4d44ccb2c515ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab.part --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab.part --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG nova.virt.images [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] 6c8156cb-5fcb-4c7d-be55-dea58d5695ea was qcow2, converting to raw {{(pid=72409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab.part /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab.converted {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-2258d127-e785-4aab-a149-5e8a457cba63 req-f3ddb499-cafc-4dd4-81b1-72bc4d90afe1 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2258d127-e785-4aab-a149-5e8a457cba63 req-f3ddb499-cafc-4dd4-81b1-72bc4d90afe1 service nova] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2258d127-e785-4aab-a149-5e8a457cba63 req-f3ddb499-cafc-4dd4-81b1-72bc4d90afe1 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2258d127-e785-4aab-a149-5e8a457cba63 req-f3ddb499-cafc-4dd4-81b1-72bc4d90afe1 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG nova.compute.manager [req-2258d127-e785-4aab-a149-5e8a457cba63 req-f3ddb499-cafc-4dd4-81b1-72bc4d90afe1 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] No waiting events found dispatching network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:09:13 user nova-compute[72409]: WARNING nova.compute.manager [req-2258d127-e785-4aab-a149-5e8a457cba63 req-f3ddb499-cafc-4dd4-81b1-72bc4d90afe1 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received unexpected event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 for instance with vm_state active and task_state rescuing.
Aug 09 23:09:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab.part /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab.converted" returned: 0 in 0.585s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab.converted --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "8123f34a0823bcf017f41195ac4d44ccb2c515ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.097s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "8123f34a0823bcf017f41195ac4d44ccb2c515ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "8123f34a0823bcf017f41195ac4d44ccb2c515ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab --force-share --output=json" returned: 0 in 0.166s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab,backing_fmt=raw /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.rescue {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab,backing_fmt=raw /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.rescue" returned: 0 in 0.051s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "8123f34a0823bcf017f41195ac4d44ccb2c515ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'migration_context' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Start _get_guest_xml network_info=[{"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "vif_mac": "fa:16:3e:15:28:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6c8156cb-5fcb-4c7d-be55-dea58d5695ea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkfbvMVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'a75a5458-8710-425d-9755-dc2dc71f7d5e', 'attached_at': '', 'detached_at': '', 'volume_id': '114ce0a8-4337-4129-aadf-6f0cf20af81a', 'serial': '114ce0a8-4337-4129-aadf-6f0cf20af81a'}, 'mount_device': '/dev/vdb', 'attachment_id': 'd404e4f2-57f7-486e-adbd-2942fab0ba18', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'resources' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'numa_topology' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:09:14 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:09:14 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'vcpu_model' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkfbvMVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:09:14 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:09:14 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:09:14 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6294fd1a-4532-45b2-b03f-790d2b818be2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JkfbvMVy\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 23:09:14 user nova-compute[72409]: node.name = iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a
Aug 09 23:09:14 user nova-compute[72409]: node.tpgt = -1
Aug 09 23:09:14 user nova-compute[72409]: node.startup = automatic
Aug 09 23:09:14 user nova-compute[72409]: node.leading_login = No
Aug 09 23:09:14 user nova-compute[72409]: iface.iscsi_ifacename = default
Aug 09 23:09:14 user nova-compute[72409]: iface.net_ifacename = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.ipaddress = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.prefix_len = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.hwaddress = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.transport_name = tcp
Aug 09 23:09:14 user nova-compute[72409]: iface.initiatorname = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.state = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.vlan_id = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.vlan_priority = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.vlan_state = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.iface_num = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.mtu = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.port = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.bootproto = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.subnet_mask = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.gateway = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.dhcp_alt_client_id = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.dhcp_dns = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.dhcp_learn_iqn = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.dhcp_vendor_id_state = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.dhcp_vendor_id = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.dhcp_slp_da = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.fragmentation = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.gratuitous_arp = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.incoming_forwarding = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.tos_state = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.tos = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.ttl = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.delayed_ack = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.tcp_nagle = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.tcp_wsf_state = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.tcp_wsf = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.tcp_timer_scale = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.tcp_timestamp = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.redirect = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.def_task_mgmt_timeout = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.header_digest = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.data_digest = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.immediate_data = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.initial_r2t = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.data_seq_inorder = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.data_pdu_inorder = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.erl = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.max_receive_data_len = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.first_burst_len = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.max_outstanding_r2t = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.max_burst_len = 0
Aug 09 23:09:14 user nova-compute[72409]: iface.chap_auth = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.bidi_chap = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.strict_login_compliance = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.discovery_auth = <empty>
Aug 09 23:09:14 user nova-compute[72409]: iface.discovery_logout = <empty>
Aug 09 23:09:14 user nova-compute[72409]: node.discovery_address = <empty>
Aug 09 23:09:14 user nova-compute[72409]: node.discovery_port = 0
Aug 09 23:09:14 user nova-compute[72409]: node.discovery_type = static
Aug 09 23:09:14 user nova-compute[72409]: node.session.initial_cmdsn = 0
Aug 09 23:09:14 user nova-compute[72409]: node.session.initial_login_retry_max = 8
Aug 09 23:09:14 user nova-compute[72409]: node.session.xmit_thread_priority = -20
Aug 09 23:09:14 user nova-compute[72409]: node.session.cmds_max = 128
Aug 09 23:09:14 user nova-compute[72409]: node.session.queue_depth = 32
Aug 09 23:09:14 user nova-compute[72409]: node.session.nr_sessions = 1
Aug 09 23:09:14 user nova-compute[72409]: node.session.auth.authmethod = CHAP
Aug 09 23:09:14 user nova-compute[72409]: node.session.auth.username = JkfbvMVy
Aug 09 23:09:14 user nova-compute[72409]: node.session.auth.password = ***
Aug 09 23:09:14 user nova-compute[72409]: node.session.auth.username_in = <empty>
Aug 09 23:09:14 user nova-compute[72409]: node.session.auth.password_in = <empty>
Aug 09 23:09:14 user nova-compute[72409]: node.session.auth.chap_algs = MD5
Aug 09 23:09:14 user nova-compute[72409]: node.session.timeo.replacement_timeout = 120
Aug 09 23:09:14 user nova-compute[72409]: node.session.err_timeo.abort_timeout = 15
Aug 09 23:09:14 user nova-compute[72409]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 23:09:14 user nova-compute[72409]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 23:09:14 user nova-compute[72409]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 23:09:14 user nova-compute[72409]: node.session.iscsi.FastAbort = Yes
Aug 09 23:09:14 user nova-compute[72409]: node.session.iscsi.InitialR2T = No
Aug 09 23:09:14 user nova-compute[72409]: node.session.iscsi.ImmediateData = Yes
Aug 09 23:09:14 user nova-compute[72409]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 23:09:14 user nova-compute[72409]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 23:09:14 user nova-compute[72409]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 23:09:14 user nova-compute[72409]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 23:09:14 user nova-compute[72409]: node.session.iscsi.MaxConnections = 1
Aug 09 23:09:14 user nova-compute[72409]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 23:09:14 user nova-compute[72409]: node.session.iscsi.ERL = 0
Aug 09 23:09:14 user nova-compute[72409]: node.session.scan = manual
Aug 09 23:09:14 user nova-compute[72409]: node.session.reopen_max = 0
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].address = 172.16.0.220
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].port = 3260
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].startup = manual
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].tcp.window_size = 524288
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].tcp.type_of_service = 0
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].timeo.logout_timeout = 15
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].timeo.login_timeout = 15
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].timeo.auth_timeout = 45
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].iscsi.DataDigest = None
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].iscsi.IFMarker = No
Aug 09 23:09:14 user nova-compute[72409]: node.conn[0].iscsi.OFMarker = No
Aug 09 23:09:14 user nova-compute[72409]: # END RECORD
Aug 09 23:09:14 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabd50b6-d925-4623-aaff-10ade746c11a]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f5f4fc-1cd8-4fe3-80e7-840f57dc3eea]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkfbvMVy {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkfbvMVy" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a514377-6409-42cc-a2f6-4578efcba8a7]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkfbvMVy'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e480360-a19f-4954-9374-61a464cc94eb]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f4b5c7-aa56-4e7d-8e36-e037a745a39b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:09:14 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:09:14 user nova-compute[72409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)
Aug 09 23:09:14 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:09:14 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:09:14 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:09:14 user nova-compute[72409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)
Aug 09 23:09:14 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:09:14 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] HCTL ('36', '0', '0', 0) found on session 46 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e619413f-071a-490b-8f76-6be73beb5176]: (4, ('0 0 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Searching for a device in session 46 and hctl ('36', '0', '0', 0) yield: sde {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkfbvMVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.167s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] <== connect_volume: return (168ms) {'type': 'block', 'scsi_wwn': '23538313433333339', 'path': '/dev/sde'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538313433333339', 'path': '/dev/sde'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1160653917',display_name='tempest-ServerStableDeviceRescueTest-server-1160653917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1160653917',id=35,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnf38V2OuD96vJjhFZoJ5nm87MXR7+3d+L+cKtAMz4KfRBBR78yAxB8Mtao/xryU8hisujP277ogXOA2H+zoEvWtKW+FemUZhOHblLHBOi+JqiPbTlvQU0hppvOCFHjfA==',key_name='tempest-keypair-451174164',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:05:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='409bb8521e054a8aa8d4eff42d529f49',ramdisk_id='',reservation_id='r-a1mshumj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1483667953',owner_user_name='tempest-ServerStableDeviceRescueTest-1483667953-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:07:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feb2365fd49a41269597b3834e2ab2b6',uuid=a75a5458-8710-425d-9755-dc2dc71f7d5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "vif_mac": "fa:16:3e:15:28:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Converting VIF {"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "vif_mac": "fa:16:3e:15:28:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=471b5fc0-921e-4944-b012-6d2cdcb0f246,network=Network(8d9e93ae-10cf-42b4-a277-297161eb3559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5fc0-92') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.objects.instance [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'pci_devices' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:09:14 user nova-compute[72409]:   <uuid>a75a5458-8710-425d-9755-dc2dc71f7d5e</uuid>
Aug 09 23:09:14 user nova-compute[72409]:   <name>instance-00000023</name>
Aug 09 23:09:14 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:09:14 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:09:14 user nova-compute[72409]:   <metadata>
Aug 09 23:09:14 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:09:14 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:09:14 user nova-compute[72409]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1160653917</nova:name>
Aug 09 23:09:14 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:09:14</nova:creationTime>
Aug 09 23:09:14 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:09:14 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:09:14 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:09:14 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:09:14 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:09:14 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:09:14 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:09:14 user nova-compute[72409]:       <nova:owner>
Aug 09 23:09:14 user nova-compute[72409]:         <nova:user uuid="feb2365fd49a41269597b3834e2ab2b6">tempest-ServerStableDeviceRescueTest-1483667953-project-member</nova:user>
Aug 09 23:09:14 user nova-compute[72409]:         <nova:project uuid="409bb8521e054a8aa8d4eff42d529f49">tempest-ServerStableDeviceRescueTest-1483667953</nova:project>
Aug 09 23:09:14 user nova-compute[72409]:       </nova:owner>
Aug 09 23:09:14 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:09:14 user nova-compute[72409]:       <nova:ports>
Aug 09 23:09:14 user nova-compute[72409]:         <nova:port uuid="471b5fc0-921e-4944-b012-6d2cdcb0f246">
Aug 09 23:09:14 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 23:09:14 user nova-compute[72409]:         </nova:port>
Aug 09 23:09:14 user nova-compute[72409]:       </nova:ports>
Aug 09 23:09:14 user nova-compute[72409]:     </nova:instance>
Aug 09 23:09:14 user nova-compute[72409]:   </metadata>
Aug 09 23:09:14 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:09:14 user nova-compute[72409]:     <system>
Aug 09 23:09:14 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:09:14 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:09:14 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:09:14 user nova-compute[72409]:       <entry name="serial">a75a5458-8710-425d-9755-dc2dc71f7d5e</entry>
Aug 09 23:09:14 user nova-compute[72409]:       <entry name="uuid">a75a5458-8710-425d-9755-dc2dc71f7d5e</entry>
Aug 09 23:09:14 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:09:14 user nova-compute[72409]:     </system>
Aug 09 23:09:14 user nova-compute[72409]:   </sysinfo>
Aug 09 23:09:14 user nova-compute[72409]:   <os>
Aug 09 23:09:14 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:09:14 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:09:14 user nova-compute[72409]:   </os>
Aug 09 23:09:14 user nova-compute[72409]:   <features>
Aug 09 23:09:14 user nova-compute[72409]:     <acpi/>
Aug 09 23:09:14 user nova-compute[72409]:     <apic/>
Aug 09 23:09:14 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:09:14 user nova-compute[72409]:   </features>
Aug 09 23:09:14 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:09:14 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:09:14 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:09:14 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:09:14 user nova-compute[72409]:   </clock>
Aug 09 23:09:14 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:09:14 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:09:14 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:09:14 user nova-compute[72409]:   </cpu>
Aug 09 23:09:14 user nova-compute[72409]:   <devices>
Aug 09 23:09:14 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:09:14 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:09:14 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk"/>
Aug 09 23:09:14 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:09:14 user nova-compute[72409]:     </disk>
Aug 09 23:09:14 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 23:09:14 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:09:14 user nova-compute[72409]:       <source dev="/dev/sde"/>
Aug 09 23:09:14 user nova-compute[72409]:       <target dev="vdb" bus="virtio"/>
Aug 09 23:09:14 user nova-compute[72409]:       <serial>114ce0a8-4337-4129-aadf-6f0cf20af81a</serial>
Aug 09 23:09:14 user nova-compute[72409]:     </disk>
Aug 09 23:09:14 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:09:14 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:09:14 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.rescue"/>
Aug 09 23:09:14 user nova-compute[72409]:       <target dev="vdc" bus="virtio"/>
Aug 09 23:09:14 user nova-compute[72409]:       <boot order="1"/>
Aug 09 23:09:14 user nova-compute[72409]:     </disk>
Aug 09 23:09:14 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:09:14 user nova-compute[72409]:       <mac address="fa:16:3e:15:28:f7"/>
Aug 09 23:09:14 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:09:14 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:09:14 user nova-compute[72409]:       <target dev="tap471b5fc0-92"/>
Aug 09 23:09:14 user nova-compute[72409]:     </interface>
Aug 09 23:09:14 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:09:14 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/console.log" append="off"/>
Aug 09 23:09:14 user nova-compute[72409]:     </serial>
Aug 09 23:09:14 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:09:14 user nova-compute[72409]:     <video>
Aug 09 23:09:14 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:09:14 user nova-compute[72409]:     </video>
Aug 09 23:09:14 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:09:14 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:09:14 user nova-compute[72409]:     </rng>
Aug 09 23:09:14 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:09:14 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:09:14 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:09:14 user nova-compute[72409]:     </memballoon>
Aug 09 23:09:14 user nova-compute[72409]:   </devices>
Aug 09 23:09:14 user nova-compute[72409]: </domain>
Aug 09 23:09:14 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:09:14 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Instance destroyed successfully.
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] No VIF found with MAC fa:16:3e:15:28:f7, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:09:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-e8553805-3eea-4d49-b9a6-fee2724e1a33 req-45f4491d-237f-4aa2-9f2b-d2023eacadb4 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:09:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e8553805-3eea-4d49-b9a6-fee2724e1a33 req-45f4491d-237f-4aa2-9f2b-d2023eacadb4 service nova] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e8553805-3eea-4d49-b9a6-fee2724e1a33 req-45f4491d-237f-4aa2-9f2b-d2023eacadb4 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e8553805-3eea-4d49-b9a6-fee2724e1a33 req-45f4491d-237f-4aa2-9f2b-d2023eacadb4 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:16 user nova-compute[72409]: DEBUG nova.compute.manager [req-e8553805-3eea-4d49-b9a6-fee2724e1a33 req-45f4491d-237f-4aa2-9f2b-d2023eacadb4 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] No waiting events found dispatching network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:09:16 user nova-compute[72409]: WARNING nova.compute.manager [req-e8553805-3eea-4d49-b9a6-fee2724e1a33 req-45f4491d-237f-4aa2-9f2b-d2023eacadb4 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received unexpected event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 for instance with vm_state active and task_state rescuing.
Aug 09 23:09:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:18 user nova-compute[72409]: DEBUG nova.compute.manager [req-9f9d59eb-812c-4ae8-ae1b-4d2766e5b0c4 req-522af7d6-f4e5-406c-bd0c-456342ec2ffd service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:09:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9f9d59eb-812c-4ae8-ae1b-4d2766e5b0c4 req-522af7d6-f4e5-406c-bd0c-456342ec2ffd service nova] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9f9d59eb-812c-4ae8-ae1b-4d2766e5b0c4 req-522af7d6-f4e5-406c-bd0c-456342ec2ffd service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9f9d59eb-812c-4ae8-ae1b-4d2766e5b0c4 req-522af7d6-f4e5-406c-bd0c-456342ec2ffd service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:18 user nova-compute[72409]: DEBUG nova.compute.manager [req-9f9d59eb-812c-4ae8-ae1b-4d2766e5b0c4 req-522af7d6-f4e5-406c-bd0c-456342ec2ffd service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] No waiting events found dispatching network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:09:18 user nova-compute[72409]: WARNING nova.compute.manager [req-9f9d59eb-812c-4ae8-ae1b-4d2766e5b0c4 req-522af7d6-f4e5-406c-bd0c-456342ec2ffd service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received unexpected event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 for instance with vm_state active and task_state rescuing.
Aug 09 23:09:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Removed pending event for a75a5458-8710-425d-9755-dc2dc71f7d5e due to event {{(pid=72409) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 23:09:18 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622558.6189797, a75a5458-8710-425d-9755-dc2dc71f7d5e => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:09:18 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] VM Resumed (Lifecycle Event)
Aug 09 23:09:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e3f0fd62-d76a-48ec-83fa-855d56ebca00 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:09:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:09:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:09:18 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 23:09:18 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622558.6197076, a75a5458-8710-425d-9755-dc2dc71f7d5e => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:09:18 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] VM Started (Lifecycle Event)
Aug 09 23:09:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:09:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:09:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:24 user nova-compute[72409]: INFO nova.compute.manager [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Detaching volume deac1c6a-1845-4f3d-8ece-7cdc436af13d
Aug 09 23:09:24 user nova-compute[72409]: INFO nova.virt.block_device [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attempting to driver detach volume deac1c6a-1845-4f3d-8ece-7cdc436af13d from mountpoint /dev/vdb
Aug 09 23:09:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Attempting to detach device vdb from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:09:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:09:24 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:09:24 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:09:24 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:09:24 user nova-compute[72409]:   <serial>deac1c6a-1845-4f3d-8ece-7cdc436af13d</serial>
Aug 09 23:09:24 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:09:24 user nova-compute[72409]: </disk>
Aug 09 23:09:24 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:09:24 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Successfully detached device vdb from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the persistent domain config.
Aug 09 23:09:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:09:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:09:24 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:09:24 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:09:24 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:09:24 user nova-compute[72409]:   <serial>deac1c6a-1845-4f3d-8ece-7cdc436af13d</serial>
Aug 09 23:09:24 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:09:24 user nova-compute[72409]: </disk>
Aug 09 23:09:24 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:09:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622565.1017776, e870efcb-fcb2-4dda-b92a-538fd06f16a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:09:25 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Successfully detached device vdb from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the live domain config.
Aug 09 23:09:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZaTsUcD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:09:25 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feafa9f-8323-4077-8dc0-6c1cd681f46e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88cee89-fdad-4843-9894-b959b126c0d4]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:09:25 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:09:25 user nova-compute[72409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)
Aug 09 23:09:25 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:09:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:09:25 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:09:25 user nova-compute[72409]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d (non-flash)
Aug 09 23:09:25 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:09:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e943c48b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bc4d88-6a0f-4184-bb84-e41bab7d0f0c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65ad45f-ef7e-4261-aa02-f1e7884e0d77]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4682bf0c-0cef-4c43-96d4-69c024ec5933]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e031cce3-7848-4eb1-9acd-f9e46eb9e536]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2c0a55-71ef-473a-8984-befa1aecda7d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26d2131-09d8-45b5-a3dd-07b18a7d8090]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d, portal: 172.16.0.220,3260]
Aug 09 23:09:25 user nova-compute[72409]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d, portal: 172.16.0.220,3260] successful.
Aug 09 23:09:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deac1c6a-1845-4f3d-8ece-7cdc436af13d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[71faf8a1-4b05-433d-9b38-1bf07be686ec]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] <== disconnect_volume: return (337ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:09:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:09:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:32 user nova-compute[72409]: DEBUG nova.objects.instance [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'flavor' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:09:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-88a51300-d3e2-4947-9de8-06e51b69567b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.155s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:09:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:09:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:09:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:09:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:09:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:43 user nova-compute[72409]: INFO nova.compute.manager [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Terminating instance
Aug 09 23:09:43 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:09:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-b18d9d0b-ce12-42d8-af7b-9176139fb4ac req-18ee5a23-3ca2-4d70-9e8b-405504ea9862 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received event network-vif-unplugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b18d9d0b-ce12-42d8-af7b-9176139fb4ac req-18ee5a23-3ca2-4d70-9e8b-405504ea9862 service nova] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b18d9d0b-ce12-42d8-af7b-9176139fb4ac req-18ee5a23-3ca2-4d70-9e8b-405504ea9862 service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b18d9d0b-ce12-42d8-af7b-9176139fb4ac req-18ee5a23-3ca2-4d70-9e8b-405504ea9862 service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-b18d9d0b-ce12-42d8-af7b-9176139fb4ac req-18ee5a23-3ca2-4d70-9e8b-405504ea9862 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] No waiting events found dispatching network-vif-unplugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-b18d9d0b-ce12-42d8-af7b-9176139fb4ac req-18ee5a23-3ca2-4d70-9e8b-405504ea9862 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received event network-vif-unplugged-b699c9c4-31f5-41b2-ac73-16353dceb256 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Instance destroyed successfully.
Aug 09 23:09:44 user nova-compute[72409]: DEBUG nova.objects.instance [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'resources' on Instance uuid b0c67c33-9d1a-4479-a64f-8f867330b9dc {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1886528577',display_name='tempest-ServerActionsTestOtherA-server-1886528577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1886528577',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzHC0syLklL8GtXvz6DwLHZAI3KijCzzG+c3H7vbfCfvBbdLu31zQrL5KQv6qO6LPapTOC2Zi0KeYbsTlIE+6d9oW1MPV8oBMrDCQEY9sL1aQ71vDiQHBGpACA1bJ0plQ==',key_name='tempest-keypair-183406528',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:05:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c7e3f592e7141659581ae7f67c6af43',ramdisk_id='',reservation_id='r-w5z89s1i',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-640999933',owner_user_name='tempest-ServerActionsTestOtherA-640999933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd76f1c0d9b42269fcc69f24c9f59e6',uuid=b0c67c33-9d1a-4479-a64f-8f867330b9dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converting VIF {"id": "b699c9c4-31f5-41b2-ac73-16353dceb256", "address": "fa:16:3e:84:8e:ae", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb699c9c4-31", "ovs_interfaceid": "b699c9c4-31f5-41b2-ac73-16353dceb256", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_vif [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb699c9c4-31, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:44 user nova-compute[72409]: INFO os_vif [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:8e:ae,bridge_name='br-int',has_traffic_filtering=True,id=b699c9c4-31f5-41b2-ac73-16353dceb256,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb699c9c4-31')
Aug 09 23:09:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxmNSztl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:09:44 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3224249c-b5ea-469a-a620-a00e2556c7aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[19542791-4809-4a9c-9f7b-b728f191cddb]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:09:44 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:09:44 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:09:44 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 (non-flash)
Aug 09 23:09:44 user nova-compute[72409]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:09:44 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:09:44 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e8459ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89'): ({'sdd'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Removing single pathed devices sdd {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aba3029-082d-47f1-8310-cf50bbe900c7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81c83d3-cd43-4961-bd1f-4dd3ba00c68d]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Flushing IO for device /dev/sdd {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5beb38-aeb6-4e42-93e7-a582cfefbcc1]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c555cc-2eb9-40dc-8cc5-416321ef312f]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6163a8d5-4535da2e2593d9c4', '/dev/disk/by-id/scsi-23435333564613265', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6163a8d5') {{(pid=83250) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[995b1caf-ed18-4891-b314-8f8a3a95a867]: (4, None) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29e14bb-04ec-4ce6-93cd-1e614859c9fe]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0838851-39e2-4cbc-86ba-e1eb93297e97]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260]
Aug 09 23:09:44 user nova-compute[72409]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89, portal: 172.16.0.220,3260] successful.
Aug 09 23:09:44 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cced161b-4fe6-4c99-942c-06f01605ef89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc68d59e-bcba-409a-867c-a3a544c2f52d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] <== disconnect_volume: return (300ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:09:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:09:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Deleting instance files /opt/stack/data/nova/instances/b0c67c33-9d1a-4479-a64f-8f867330b9dc_del
Aug 09 23:09:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Deletion of /opt/stack/data/nova/instances/b0c67c33-9d1a-4479-a64f-8f867330b9dc_del complete
Aug 09 23:09:45 user nova-compute[72409]: INFO nova.compute.manager [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 09 23:09:45 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:09:45 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:09:45 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:09:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-14553c4c-97c5-4dbf-a1ad-c33b6bb6620a req-a062a524-f66b-4bab-8fcf-f857348201ff service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received event network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:09:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-14553c4c-97c5-4dbf-a1ad-c33b6bb6620a req-a062a524-f66b-4bab-8fcf-f857348201ff service nova] Acquiring lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-14553c4c-97c5-4dbf-a1ad-c33b6bb6620a req-a062a524-f66b-4bab-8fcf-f857348201ff service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-14553c4c-97c5-4dbf-a1ad-c33b6bb6620a req-a062a524-f66b-4bab-8fcf-f857348201ff service nova] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-14553c4c-97c5-4dbf-a1ad-c33b6bb6620a req-a062a524-f66b-4bab-8fcf-f857348201ff service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] No waiting events found dispatching network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:09:46 user nova-compute[72409]: WARNING nova.compute.manager [req-14553c4c-97c5-4dbf-a1ad-c33b6bb6620a req-a062a524-f66b-4bab-8fcf-f857348201ff service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received unexpected event network-vif-plugged-b699c9c4-31f5-41b2-ac73-16353dceb256 for instance with vm_state active and task_state deleting.
Aug 09 23:09:46 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:09:46 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Took 1.55 seconds to deallocate network for instance.
Aug 09 23:09:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:47 user nova-compute[72409]: INFO nova.compute.manager [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Took 0.74 seconds to detach 1 volumes for instance.
Aug 09 23:09:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Deleting volume: cced161b-4fe6-4c99-942c-06f01605ef89 {{(pid=72409) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 23:09:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:09:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:09:47 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:09:47 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:09:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:47 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Deleted allocations for instance b0c67c33-9d1a-4479-a64f-8f867330b9dc
Aug 09 23:09:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d2e43d02-6e4a-4f7f-9701-b15105c26e8b tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "b0c67c33-9d1a-4479-a64f-8f867330b9dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.998s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:09:48 user nova-compute[72409]: DEBUG nova.compute.manager [req-3aaf7739-184a-4992-8227-8d005552b8c6 req-0da333d9-34ae-44ea-b7df-dd07a084c6a9 service nova] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Received event network-vif-deleted-b699c9c4-31f5-41b2-ac73-16353dceb256 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:09:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:09:59 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622584.5923011, b0c67c33-9d1a-4479-a64f-8f867330b9dc => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:09:59 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] VM Stopped (Lifecycle Event)
Aug 09 23:09:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-902d56e8-14d6-47ad-aff3-6a1525afc0de None None] [instance: b0c67c33-9d1a-4479-a64f-8f867330b9dc] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:09:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:10:01 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:10:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:10:03 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:10:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:10:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:10:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:05 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:10:05 user nova-compute[72409]: INFO nova.compute.manager [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Rescuing
Aug 09 23:10:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:10:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquired lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:10:05 user nova-compute[72409]: DEBUG nova.network.neutron [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG nova.network.neutron [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Updating instance_info_cache with network_info: [{"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Releasing lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.compute.manager [req-37ade2cc-5285-4e31-946c-20ef18eb946b req-b08aba47-5ba7-4a4a-abd4-928ea04ded73 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-unplugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-37ade2cc-5285-4e31-946c-20ef18eb946b req-b08aba47-5ba7-4a4a-abd4-928ea04ded73 service nova] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-37ade2cc-5285-4e31-946c-20ef18eb946b req-b08aba47-5ba7-4a4a-abd4-928ea04ded73 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-37ade2cc-5285-4e31-946c-20ef18eb946b req-b08aba47-5ba7-4a4a-abd4-928ea04ded73 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.compute.manager [req-37ade2cc-5285-4e31-946c-20ef18eb946b req-b08aba47-5ba7-4a4a-abd4-928ea04ded73 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] No waiting events found dispatching network-vif-unplugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:10:07 user nova-compute[72409]: WARNING nova.compute.manager [req-37ade2cc-5285-4e31-946c-20ef18eb946b req-b08aba47-5ba7-4a4a-abd4-928ea04ded73 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received unexpected event network-vif-unplugged-7854b9ac-e7ec-486d-9e13-de3581f75379 for instance with vm_state active and task_state rescuing.
Aug 09 23:10:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:07 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Instance destroyed successfully.
Aug 09 23:10:07 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Attempting rescue
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72409) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Instance directory exists: not creating {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 23:10:07 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Creating image(s)
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "/opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "/opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.objects.instance [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.rescue {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.rescue" returned: 0 in 0.054s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.objects.instance [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'migration_context' on Instance uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Start _get_guest_xml network_info=[{"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "vif_mac": "fa:16:3e:aa:78:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.objects.instance [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'resources' on Instance uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.objects.instance [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'numa_topology' on Instance uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:10:07 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:10:07 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:10:07 user nova-compute[72409]: DEBUG nova.objects.instance [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-450043224',display_name='tempest-ServerRescueNegativeTestJSON-server-450043224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-450043224',id=36,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:05:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d41897ed2b644775a5dcb22d1ecd60a0',ramdisk_id='',reservation_id='r-l9q8760o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-850997564',owner_user_name='tempest-ServerRescueNegativeTestJSON-850997564-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:05:30Z,user_data=None,user_id='de2d9f7ad5bb4a93ab61ab100eb1778d',uuid=8f7e2151-3d32-4ec8-9903-f5f284879ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "vif_mac": "fa:16:3e:aa:78:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converting VIF {"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "vif_mac": "fa:16:3e:aa:78:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:78:71,bridge_name='br-int',has_traffic_filtering=True,id=7854b9ac-e7ec-486d-9e13-de3581f75379,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7854b9ac-e7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.objects.instance [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:10:08 user nova-compute[72409]:   <uuid>8f7e2151-3d32-4ec8-9903-f5f284879ae0</uuid>
Aug 09 23:10:08 user nova-compute[72409]:   <name>instance-00000024</name>
Aug 09 23:10:08 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:10:08 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:10:08 user nova-compute[72409]:   <metadata>
Aug 09 23:10:08 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:10:08 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:10:08 user nova-compute[72409]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-450043224</nova:name>
Aug 09 23:10:08 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:10:07</nova:creationTime>
Aug 09 23:10:08 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:10:08 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:10:08 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:10:08 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:10:08 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:10:08 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:10:08 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:10:08 user nova-compute[72409]:       <nova:owner>
Aug 09 23:10:08 user nova-compute[72409]:         <nova:user uuid="de2d9f7ad5bb4a93ab61ab100eb1778d">tempest-ServerRescueNegativeTestJSON-850997564-project-member</nova:user>
Aug 09 23:10:08 user nova-compute[72409]:         <nova:project uuid="d41897ed2b644775a5dcb22d1ecd60a0">tempest-ServerRescueNegativeTestJSON-850997564</nova:project>
Aug 09 23:10:08 user nova-compute[72409]:       </nova:owner>
Aug 09 23:10:08 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:10:08 user nova-compute[72409]:       <nova:ports>
Aug 09 23:10:08 user nova-compute[72409]:         <nova:port uuid="7854b9ac-e7ec-486d-9e13-de3581f75379">
Aug 09 23:10:08 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 23:10:08 user nova-compute[72409]:         </nova:port>
Aug 09 23:10:08 user nova-compute[72409]:       </nova:ports>
Aug 09 23:10:08 user nova-compute[72409]:     </nova:instance>
Aug 09 23:10:08 user nova-compute[72409]:   </metadata>
Aug 09 23:10:08 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:10:08 user nova-compute[72409]:     <system>
Aug 09 23:10:08 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:10:08 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:10:08 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:10:08 user nova-compute[72409]:       <entry name="serial">8f7e2151-3d32-4ec8-9903-f5f284879ae0</entry>
Aug 09 23:10:08 user nova-compute[72409]:       <entry name="uuid">8f7e2151-3d32-4ec8-9903-f5f284879ae0</entry>
Aug 09 23:10:08 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:10:08 user nova-compute[72409]:     </system>
Aug 09 23:10:08 user nova-compute[72409]:   </sysinfo>
Aug 09 23:10:08 user nova-compute[72409]:   <os>
Aug 09 23:10:08 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:10:08 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:10:08 user nova-compute[72409]:   </os>
Aug 09 23:10:08 user nova-compute[72409]:   <features>
Aug 09 23:10:08 user nova-compute[72409]:     <acpi/>
Aug 09 23:10:08 user nova-compute[72409]:     <apic/>
Aug 09 23:10:08 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:10:08 user nova-compute[72409]:   </features>
Aug 09 23:10:08 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:10:08 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:10:08 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:10:08 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:10:08 user nova-compute[72409]:   </clock>
Aug 09 23:10:08 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:10:08 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:10:08 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:10:08 user nova-compute[72409]:   </cpu>
Aug 09 23:10:08 user nova-compute[72409]:   <devices>
Aug 09 23:10:08 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:10:08 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:10:08 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.rescue"/>
Aug 09 23:10:08 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:10:08 user nova-compute[72409]:     </disk>
Aug 09 23:10:08 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:10:08 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:10:08 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk"/>
Aug 09 23:10:08 user nova-compute[72409]:       <target dev="vdb" bus="virtio"/>
Aug 09 23:10:08 user nova-compute[72409]:     </disk>
Aug 09 23:10:08 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:10:08 user nova-compute[72409]:       <mac address="fa:16:3e:aa:78:71"/>
Aug 09 23:10:08 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:10:08 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:10:08 user nova-compute[72409]:       <target dev="tap7854b9ac-e7"/>
Aug 09 23:10:08 user nova-compute[72409]:     </interface>
Aug 09 23:10:08 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:10:08 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/console.log" append="off"/>
Aug 09 23:10:08 user nova-compute[72409]:     </serial>
Aug 09 23:10:08 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:10:08 user nova-compute[72409]:     <video>
Aug 09 23:10:08 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:10:08 user nova-compute[72409]:     </video>
Aug 09 23:10:08 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:10:08 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:10:08 user nova-compute[72409]:     </rng>
Aug 09 23:10:08 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:10:08 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:10:08 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:10:08 user nova-compute[72409]:     </memballoon>
Aug 09 23:10:08 user nova-compute[72409]:   </devices>
Aug 09 23:10:08 user nova-compute[72409]: </domain>
Aug 09 23:10:08 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:10:08 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Instance destroyed successfully.
Aug 09 23:10:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No VIF found with MAC fa:16:3e:aa:78:71, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:08 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:10:08 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7918MB free_disk=25.234554290771484GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f216945-199d-4047-8bc8-407d5842c536 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a75a5458-8710-425d-9755-dc2dc71f7d5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a97303da-cb91-40b9-a7bc-c674365a482e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:10:08 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-c1afecc3-b58a-4de9-b6ee-52b358bdab56 req-848161c5-c1ac-4b54-aaa5-36c8dc674565 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c1afecc3-b58a-4de9-b6ee-52b358bdab56 req-848161c5-c1ac-4b54-aaa5-36c8dc674565 service nova] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c1afecc3-b58a-4de9-b6ee-52b358bdab56 req-848161c5-c1ac-4b54-aaa5-36c8dc674565 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c1afecc3-b58a-4de9-b6ee-52b358bdab56 req-848161c5-c1ac-4b54-aaa5-36c8dc674565 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-c1afecc3-b58a-4de9-b6ee-52b358bdab56 req-848161c5-c1ac-4b54-aaa5-36c8dc674565 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] No waiting events found dispatching network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:10:09 user nova-compute[72409]: WARNING nova.compute.manager [req-c1afecc3-b58a-4de9-b6ee-52b358bdab56 req-848161c5-c1ac-4b54-aaa5-36c8dc674565 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received unexpected event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 for instance with vm_state active and task_state rescuing.
Aug 09 23:10:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-0c911fd4-88b1-4e3a-8f4d-e167964f811d req-15c4b9b0-28f7-49a6-b4a3-6bc0bdd949a5 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0c911fd4-88b1-4e3a-8f4d-e167964f811d req-15c4b9b0-28f7-49a6-b4a3-6bc0bdd949a5 service nova] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0c911fd4-88b1-4e3a-8f4d-e167964f811d req-15c4b9b0-28f7-49a6-b4a3-6bc0bdd949a5 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0c911fd4-88b1-4e3a-8f4d-e167964f811d req-15c4b9b0-28f7-49a6-b4a3-6bc0bdd949a5 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-0c911fd4-88b1-4e3a-8f4d-e167964f811d req-15c4b9b0-28f7-49a6-b4a3-6bc0bdd949a5 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] No waiting events found dispatching network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:10:11 user nova-compute[72409]: WARNING nova.compute.manager [req-0c911fd4-88b1-4e3a-8f4d-e167964f811d req-15c4b9b0-28f7-49a6-b4a3-6bc0bdd949a5 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received unexpected event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 for instance with vm_state active and task_state rescuing.
Aug 09 23:10:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-0c911fd4-88b1-4e3a-8f4d-e167964f811d req-15c4b9b0-28f7-49a6-b4a3-6bc0bdd949a5 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0c911fd4-88b1-4e3a-8f4d-e167964f811d req-15c4b9b0-28f7-49a6-b4a3-6bc0bdd949a5 service nova] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0c911fd4-88b1-4e3a-8f4d-e167964f811d req-15c4b9b0-28f7-49a6-b4a3-6bc0bdd949a5 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0c911fd4-88b1-4e3a-8f4d-e167964f811d req-15c4b9b0-28f7-49a6-b4a3-6bc0bdd949a5 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-0c911fd4-88b1-4e3a-8f4d-e167964f811d req-15c4b9b0-28f7-49a6-b4a3-6bc0bdd949a5 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] No waiting events found dispatching network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:10:11 user nova-compute[72409]: WARNING nova.compute.manager [req-0c911fd4-88b1-4e3a-8f4d-e167964f811d req-15c4b9b0-28f7-49a6-b4a3-6bc0bdd949a5 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received unexpected event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 for instance with vm_state active and task_state rescuing.
Aug 09 23:10:11 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Removed pending event for 8f7e2151-3d32-4ec8-9903-f5f284879ae0 due to event {{(pid=72409) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622611.6203365, 8f7e2151-3d32-4ec8-9903-f5f284879ae0 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:10:11 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] VM Resumed (Lifecycle Event)
Aug 09 23:10:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-09c53b2f-639e-4efa-9645-52b96f1978f4 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:10:11 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 23:10:11 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622611.6245422, 8f7e2151-3d32-4ec8-9903-f5f284879ae0 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:10:11 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] VM Started (Lifecycle Event)
Aug 09 23:10:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:10:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:10:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:10:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:10:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:10:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:10:12 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:10:12 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updating instance_info_cache with network_info: [{"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:10:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:10:13 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:10:13 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:10:13 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:10:13 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:10:13 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:10:13 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:10:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:18 user nova-compute[72409]: DEBUG nova.objects.instance [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'flavor' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:10:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:19 user nova-compute[72409]: INFO nova.compute.manager [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attaching volume f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 to /dev/vdb
Aug 09 23:10:19 user nova-compute[72409]: DEBUG os_brick.utils [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4015b683-9c47-446d-9c7c-88ae1d376ede]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[547a3bdb-452e-4d7d-8547-398326c6777c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.111s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf86a52b-eb55-41b0-93e3-64e22995c060]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6642002-327a-41b2-99c9-064265512121]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:10:19 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:10:19 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e63cbe-ad93-4de3-8e05-73a2c09d7615]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG os_brick.utils [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] <== get_connector_properties: return (217ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Updating existing volume attachment record: afae3c51-e14f-4129-8d63-5dd00731e7ca {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:10:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KkIxXJHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:10:28 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:10:28 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:10:28 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[11417a32-969c-459a-a356-e58bfc4edb1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:10:28 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e477057-bc0a-4e26-a34a-7a2ca40d101c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32] added
Aug 09 23:10:28 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[23684e4b-6f5b-4d8f-98cc-b5cf672d3056]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a402810-2091-44e8-bb4d-6d4a11585eab]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KkIxXJHs {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KkIxXJHs" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1116c0-c733-4308-b71e-e01b6f653fb5]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KkIxXJHs'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1d91df-706b-49f4-82cf-cabda1f71c27]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[65272610-376e-4fbd-8fbd-0aabb7e277af]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:10:28 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:10:28 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:10:28 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:10:28 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[78895bf5-43e3-4b20-bd1b-0466598771da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32, portal: 172.16.0.220,3260]
Aug 09 23:10:28 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32, portal: 172.16.0.220,3260] successful.
Aug 09 23:10:28 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[869e4a6b-6099-499d-bc58-4b7ccfdc77bd]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4863ff-0613-49ee-aea8-c40464400f39]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:10:28 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:10:28 user nova-compute[72409]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 (non-flash)
Aug 09 23:10:28 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:10:28 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:10:28 user nova-compute[72409]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 (non-flash)
Aug 09 23:10:28 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[144acfb4-088e-44bf-9bda-7c7022e105dd]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:28 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:10:29 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:10:29 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KkIxXJHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:10:29 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:10:29 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26331313235623061', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:10:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331313235623061', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:10:29 user nova-compute[72409]: DEBUG nova.objects.instance [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'flavor' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:10:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:10:29 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:10:29 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:10:29 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:10:29 user nova-compute[72409]:   <serial>f92c00a4-7113-4fec-8c40-bd2fb7ca8c32</serial>
Aug 09 23:10:29 user nova-compute[72409]: </disk>
Aug 09 23:10:29 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:10:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:10:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:10:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No VIF found with MAC fa:16:3e:1e:a5:0b, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:10:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ebcb8c9d-946f-4bb7-bf18-87390c8e385b tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.818s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:32 user nova-compute[72409]: INFO nova.compute.manager [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Detaching volume f92c00a4-7113-4fec-8c40-bd2fb7ca8c32
Aug 09 23:10:32 user nova-compute[72409]: INFO nova.virt.block_device [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attempting to driver detach volume f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 from mountpoint /dev/vdb
Aug 09 23:10:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Attempting to detach device vdb from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:10:32 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:10:32 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:10:32 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:10:32 user nova-compute[72409]:   <serial>f92c00a4-7113-4fec-8c40-bd2fb7ca8c32</serial>
Aug 09 23:10:32 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:10:32 user nova-compute[72409]: </disk>
Aug 09 23:10:32 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:10:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Successfully detached device vdb from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the persistent domain config.
Aug 09 23:10:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:10:32 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:10:32 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:10:32 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:10:32 user nova-compute[72409]:   <serial>f92c00a4-7113-4fec-8c40-bd2fb7ca8c32</serial>
Aug 09 23:10:32 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:10:32 user nova-compute[72409]: </disk>
Aug 09 23:10:32 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622632.945196, e870efcb-fcb2-4dda-b92a-538fd06f16a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:10:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Successfully detached device vdb from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the live domain config.
Aug 09 23:10:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KkIxXJHs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:10:32 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:10:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5122dc98-affb-4374-8c74-33db0caebb73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cf204a-547a-4072-a1d7-0d0e8d7a982c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:10:33 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:10:33 user nova-compute[72409]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 (non-flash)
Aug 09 23:10:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:10:33 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:10:33 user nova-compute[72409]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 (non-flash)
Aug 09 23:10:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e8431fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[874b7e6a-19a4-4646-9686-2591af93f8ec]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[418b989f-dc74-4211-9660-7c52166c0395]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9558273f-639c-4681-82ef-a8098df297d3]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd43165-3292-4156-948b-7530aaa9970f]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb27a4f1-23fa-4fe5-90eb-1b4435db5ac3]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad268d78-4adb-4970-aa96-2b5803b57a52]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32, portal: 172.16.0.220,3260]
Aug 09 23:10:33 user nova-compute[72409]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32, portal: 172.16.0.220,3260] successful.
Aug 09 23:10:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f92c00a4-7113-4fec-8c40-bd2fb7ca8c32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d30cc2-6687-4d51-97a0-3d26e664bd70]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] <== disconnect_volume: return (302ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:10:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:10:34 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'flavor' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:10:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c77d8175-f2a9-486a-a389-92d4ab172858 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.721s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-37feef92-0117-4234-8cb9-d9ade3de702f req-0431637d-787f-484c-802a-f1171024ceaa service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Received event network-changed-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:10:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-37feef92-0117-4234-8cb9-d9ade3de702f req-0431637d-787f-484c-802a-f1171024ceaa service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Refreshing instance network info cache due to event network-changed-88c8db8a-4d24-48f5-b62e-03b2eb95ba33. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:10:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-37feef92-0117-4234-8cb9-d9ade3de702f req-0431637d-787f-484c-802a-f1171024ceaa service nova] Acquiring lock "refresh_cache-a97303da-cb91-40b9-a7bc-c674365a482e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:10:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-37feef92-0117-4234-8cb9-d9ade3de702f req-0431637d-787f-484c-802a-f1171024ceaa service nova] Acquired lock "refresh_cache-a97303da-cb91-40b9-a7bc-c674365a482e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:10:35 user nova-compute[72409]: DEBUG nova.network.neutron [req-37feef92-0117-4234-8cb9-d9ade3de702f req-0431637d-787f-484c-802a-f1171024ceaa service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Refreshing network info cache for port 88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:10:36 user nova-compute[72409]: DEBUG nova.network.neutron [req-37feef92-0117-4234-8cb9-d9ade3de702f req-0431637d-787f-484c-802a-f1171024ceaa service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Updated VIF entry in instance network info cache for port 88c8db8a-4d24-48f5-b62e-03b2eb95ba33. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:10:36 user nova-compute[72409]: DEBUG nova.network.neutron [req-37feef92-0117-4234-8cb9-d9ade3de702f req-0431637d-787f-484c-802a-f1171024ceaa service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Updating instance_info_cache with network_info: [{"id": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "address": "fa:16:3e:8c:ea:41", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8db8a-4d", "ovs_interfaceid": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:10:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-37feef92-0117-4234-8cb9-d9ade3de702f req-0431637d-787f-484c-802a-f1171024ceaa service nova] Releasing lock "refresh_cache-a97303da-cb91-40b9-a7bc-c674365a482e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:10:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "3f216945-199d-4047-8bc8-407d5842c536" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:40 user nova-compute[72409]: INFO nova.compute.manager [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Terminating instance
Aug 09 23:10:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG nova.compute.manager [req-076b17a1-f3b7-4c25-83c4-e7acd1041499 req-7186870a-9b32-45e6-80ad-f14b34721c05 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-vif-unplugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-076b17a1-f3b7-4c25-83c4-e7acd1041499 req-7186870a-9b32-45e6-80ad-f14b34721c05 service nova] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-076b17a1-f3b7-4c25-83c4-e7acd1041499 req-7186870a-9b32-45e6-80ad-f14b34721c05 service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-076b17a1-f3b7-4c25-83c4-e7acd1041499 req-7186870a-9b32-45e6-80ad-f14b34721c05 service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG nova.compute.manager [req-076b17a1-f3b7-4c25-83c4-e7acd1041499 req-7186870a-9b32-45e6-80ad-f14b34721c05 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] No waiting events found dispatching network-vif-unplugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:10:40 user nova-compute[72409]: DEBUG nova.compute.manager [req-076b17a1-f3b7-4c25-83c4-e7acd1041499 req-7186870a-9b32-45e6-80ad-f14b34721c05 service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-vif-unplugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:10:41 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Instance destroyed successfully.
Aug 09 23:10:41 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lazy-loading 'resources' on Instance uuid 3f216945-199d-4047-8bc8-407d5842c536 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:10:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T22:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-869366492',display_name='tempest-ServerActionsTestOtherA-server-1401261704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-869366492',id=16,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzHC0syLklL8GtXvz6DwLHZAI3KijCzzG+c3H7vbfCfvBbdLu31zQrL5KQv6qO6LPapTOC2Zi0KeYbsTlIE+6d9oW1MPV8oBMrDCQEY9sL1aQ71vDiQHBGpACA1bJ0plQ==',key_name='tempest-keypair-183406528',keypairs=<?>,launch_index=0,launched_at=2023-08-09T22:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c7e3f592e7141659581ae7f67c6af43',ramdisk_id='',reservation_id='r-sst2ny3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-640999933',owner_user_name='tempest-ServerActionsTestOtherA-640999933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T22:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd76f1c0d9b42269fcc69f24c9f59e6',uuid=3f216945-199d-4047-8bc8-407d5842c536,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:10:41 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converting VIF {"id": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "address": "fa:16:3e:a7:ea:25", "network": {"id": "8e673166-b7bd-4766-bc0e-569d8b3baae2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2069897593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7e3f592e7141659581ae7f67c6af43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap410a93bc-9f", "ovs_interfaceid": "410a93bc-9f2d-473e-acfb-bf171c4bcf4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:10:41 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:10:41 user nova-compute[72409]: DEBUG os_vif [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:10:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap410a93bc-9f, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:10:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:10:41 user nova-compute[72409]: INFO os_vif [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=410a93bc-9f2d-473e-acfb-bf171c4bcf4a,network=Network(8e673166-b7bd-4766-bc0e-569d8b3baae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap410a93bc-9f')
Aug 09 23:10:41 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Deleting instance files /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536_del
Aug 09 23:10:41 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Deletion of /opt/stack/data/nova/instances/3f216945-199d-4047-8bc8-407d5842c536_del complete
Aug 09 23:10:41 user nova-compute[72409]: INFO nova.compute.manager [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 23:10:41 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:10:41 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:10:41 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 3f216945-199d-4047-8bc8-407d5842c536] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:10:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:42 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:10:42 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Took 0.98 seconds to deallocate network for instance.
Aug 09 23:10:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:42 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:10:42 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:10:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:42 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Deleted allocations for instance 3f216945-199d-4047-8bc8-407d5842c536
Aug 09 23:10:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-78a47b97-57ed-45f2-8ff3-edc50dbe9db1 req-95e321f6-583b-495e-abdc-90f1bfad365a service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:10:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-78a47b97-57ed-45f2-8ff3-edc50dbe9db1 req-95e321f6-583b-495e-abdc-90f1bfad365a service nova] Acquiring lock "3f216945-199d-4047-8bc8-407d5842c536-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-78a47b97-57ed-45f2-8ff3-edc50dbe9db1 req-95e321f6-583b-495e-abdc-90f1bfad365a service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-78a47b97-57ed-45f2-8ff3-edc50dbe9db1 req-95e321f6-583b-495e-abdc-90f1bfad365a service nova] Lock "3f216945-199d-4047-8bc8-407d5842c536-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-78a47b97-57ed-45f2-8ff3-edc50dbe9db1 req-95e321f6-583b-495e-abdc-90f1bfad365a service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] No waiting events found dispatching network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:10:42 user nova-compute[72409]: WARNING nova.compute.manager [req-78a47b97-57ed-45f2-8ff3-edc50dbe9db1 req-95e321f6-583b-495e-abdc-90f1bfad365a service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received unexpected event network-vif-plugged-410a93bc-9f2d-473e-acfb-bf171c4bcf4a for instance with vm_state deleted and task_state None.
Aug 09 23:10:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-78a47b97-57ed-45f2-8ff3-edc50dbe9db1 req-95e321f6-583b-495e-abdc-90f1bfad365a service nova] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Received event network-vif-deleted-410a93bc-9f2d-473e-acfb-bf171c4bcf4a {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:10:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9739bdef-1feb-4180-a6e4-ee4fc85af3f3 tempest-ServerActionsTestOtherA-640999933 tempest-ServerActionsTestOtherA-640999933-project-member] Lock "3f216945-199d-4047-8bc8-407d5842c536" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.494s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "3f9eb677-11aa-4398-87dd-560c055d1c2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:10:49 user nova-compute[72409]: INFO nova.compute.claims [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Claim successful on node user
Aug 09 23:10:49 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:10:49 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:10:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:10:49 user nova-compute[72409]: INFO nova.virt.block_device [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Booting with volume 6a9396d3-792d-4f0f-91e3-23b766e62369 at /dev/vda
Aug 09 23:10:49 user nova-compute[72409]: DEBUG nova.policy [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcd5e2f13e0a448e836dd8684b889a70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d29522bd16460eb1edc9fb7918111f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG os_brick.utils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8b69d2-c79f-4cb3-80cc-bbb266f7ea1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba32d23-874f-4068-bb07-28572ded5c23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f6e73f-1b4a-4b1b-b073-563a467f0a4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a961f72-5a14-446a-a322-6face65d7996]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:10:49 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:10:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7980369-2b35-4a45-8824-1887020fb211]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG os_brick.utils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:10:49 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Updating existing volume attachment record: 4816e4eb-c08f-4c57-bb1b-e1969f2c2461 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:10:50 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Successfully created port: 07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Successfully updated port: 07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "refresh_cache-3f9eb677-11aa-4398-87dd-560c055d1c2c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquired lock "refresh_cache-3f9eb677-11aa-4398-87dd-560c055d1c2c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-17b5d0ff-be3c-4692-9be4-d70894347aa4 req-c0c76692-924f-46f2-a9e2-2525b78d0953 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Received event network-changed-07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-17b5d0ff-be3c-4692-9be4-d70894347aa4 req-c0c76692-924f-46f2-a9e2-2525b78d0953 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Refreshing instance network info cache due to event network-changed-07e73e54-9d79-45d7-970f-2196aa11de52. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-17b5d0ff-be3c-4692-9be4-d70894347aa4 req-c0c76692-924f-46f2-a9e2-2525b78d0953 service nova] Acquiring lock "refresh_cache-3f9eb677-11aa-4398-87dd-560c055d1c2c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG nova.network.neutron [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Updating instance_info_cache with network_info: [{"id": "07e73e54-9d79-45d7-970f-2196aa11de52", "address": "fa:16:3e:14:1d:21", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e73e54-9d", "ovs_interfaceid": "07e73e54-9d79-45d7-970f-2196aa11de52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Releasing lock "refresh_cache-3f9eb677-11aa-4398-87dd-560c055d1c2c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Instance network_info: |[{"id": "07e73e54-9d79-45d7-970f-2196aa11de52", "address": "fa:16:3e:14:1d:21", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e73e54-9d", "ovs_interfaceid": "07e73e54-9d79-45d7-970f-2196aa11de52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-17b5d0ff-be3c-4692-9be4-d70894347aa4 req-c0c76692-924f-46f2-a9e2-2525b78d0953 service nova] Acquired lock "refresh_cache-3f9eb677-11aa-4398-87dd-560c055d1c2c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:10:51 user nova-compute[72409]: DEBUG nova.network.neutron [req-17b5d0ff-be3c-4692-9be4-d70894347aa4 req-c0c76692-924f-46f2-a9e2-2525b78d0953 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Refreshing network info cache for port 07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:10:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:52 user nova-compute[72409]: DEBUG nova.network.neutron [req-17b5d0ff-be3c-4692-9be4-d70894347aa4 req-c0c76692-924f-46f2-a9e2-2525b78d0953 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Updated VIF entry in instance network info cache for port 07e73e54-9d79-45d7-970f-2196aa11de52. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:10:52 user nova-compute[72409]: DEBUG nova.network.neutron [req-17b5d0ff-be3c-4692-9be4-d70894347aa4 req-c0c76692-924f-46f2-a9e2-2525b78d0953 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Updating instance_info_cache with network_info: [{"id": "07e73e54-9d79-45d7-970f-2196aa11de52", "address": "fa:16:3e:14:1d:21", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e73e54-9d", "ovs_interfaceid": "07e73e54-9d79-45d7-970f-2196aa11de52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:10:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-17b5d0ff-be3c-4692-9be4-d70894347aa4 req-c0c76692-924f-46f2-a9e2-2525b78d0953 service nova] Releasing lock "refresh_cache-3f9eb677-11aa-4398-87dd-560c055d1c2c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:10:56 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622641.0041935, 3f216945-199d-4047-8bc8-407d5842c536 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:10:56 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 3f216945-199d-4047-8bc8-407d5842c536] VM Stopped (Lifecycle Event)
Aug 09 23:10:56 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c3c40ad2-8c81-4753-9e80-2b04b3ae1c6f None None] [instance: 3f216945-199d-4047-8bc8-407d5842c536] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:10:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:10:58 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Creating image(s)
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Did not create local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Ensure instance console log exists: /opt/stack/data/nova/instances/3f9eb677-11aa-4398-87dd-560c055d1c2c/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Start _get_guest_xml network_info=[{"id": "07e73e54-9d79-45d7-970f-2196aa11de52", "address": "fa:16:3e:14:1d:21", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e73e54-9d", "ovs_interfaceid": "07e73e54-9d79-45d7-970f-2196aa11de52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStQZCam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3f9eb677-11aa-4398-87dd-560c055d1c2c', 'attached_at': '', 'detached_at': '', 'volume_id': '6a9396d3-792d-4f0f-91e3-23b766e62369', 'serial': '6a9396d3-792d-4f0f-91e3-23b766e62369'}, 'mount_device': '/dev/vda', 'attachment_id': '4816e4eb-c08f-4c57-bb1b-e1969f2c2461', 'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:10:58 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:10:58 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStQZCam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:10:58 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:10:58 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:10:58 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4f1018-5905-4b0b-9c6a-fcc6abed73cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:10:58 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4aa32e-71f8-4fd4-88d9-061b4e51af08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369] added
Aug 09 23:10:58 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6661e4-affb-4ab8-bc90-6d601b8310cc]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[884b195d-b51f-4a13-9a3c-bd9825524d79]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NStQZCam {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NStQZCam" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b40292e-8edb-4399-877a-97b973930c50]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NStQZCam'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d485f591-0008-4ebf-b286-a966414b72ab]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0d4123-e125-44c5-a906-6b2374f3e7a1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:10:58 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:10:58 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:10:58 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:10:58 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[147d3c3b-11c2-4b0d-86ed-c05ad789aaa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369, portal: 172.16.0.220,3260]
Aug 09 23:10:58 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369, portal: 172.16.0.220,3260] successful.
Aug 09 23:10:58 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb811d62-0ecd-4b33-921f-1357b274735d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d013b175-fb9c-47c4-947c-5650111b5968]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:10:58 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:10:58 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:10:58 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:10:58 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:10:58 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:10:58 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c932cef6-34b0-49a5-b4c0-4d86cd847d85]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:10:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStQZCam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:10:59 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:10:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 23:10:59 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:10:59 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23461663466643663', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:10:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461663466643663', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:10:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-996666832',display_name='tempest-TestVolumeBootPattern-server-996666832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-996666832',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1aHN+hYxllL5tuB8HvAlIacEjfYF+w1msAbdktrPPHCcF11JPXwNiBeUP+wL/G+SHuINuvHbsNfaNGa+fgVIlRHvAF1ETChrpZfHrOyvh53hIFQ9t/gmToggpOGTMoMw==',key_name='tempest-TestVolumeBootPattern-982211312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-o68b4tir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:10:50Z,user_data=None,user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=3f9eb677-11aa-4398-87dd-560c055d1c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07e73e54-9d79-45d7-970f-2196aa11de52", "address": "fa:16:3e:14:1d:21", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e73e54-9d", "ovs_interfaceid": "07e73e54-9d79-45d7-970f-2196aa11de52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:10:59 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "07e73e54-9d79-45d7-970f-2196aa11de52", "address": "fa:16:3e:14:1d:21", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e73e54-9d", "ovs_interfaceid": "07e73e54-9d79-45d7-970f-2196aa11de52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:10:59 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:1d:21,bridge_name='br-int',has_traffic_filtering=True,id=07e73e54-9d79-45d7-970f-2196aa11de52,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e73e54-9d') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:10:59 user nova-compute[72409]: DEBUG nova.objects.instance [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f9eb677-11aa-4398-87dd-560c055d1c2c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:10:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:10:59 user nova-compute[72409]:   <uuid>3f9eb677-11aa-4398-87dd-560c055d1c2c</uuid>
Aug 09 23:10:59 user nova-compute[72409]:   <name>instance-00000029</name>
Aug 09 23:10:59 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:10:59 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:10:59 user nova-compute[72409]:   <metadata>
Aug 09 23:10:59 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:10:59 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:10:59 user nova-compute[72409]:       <nova:name>tempest-TestVolumeBootPattern-server-996666832</nova:name>
Aug 09 23:10:59 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:10:58</nova:creationTime>
Aug 09 23:10:59 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:10:59 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:10:59 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:10:59 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:10:59 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:10:59 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:10:59 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:10:59 user nova-compute[72409]:       <nova:owner>
Aug 09 23:10:59 user nova-compute[72409]:         <nova:user uuid="bcd5e2f13e0a448e836dd8684b889a70">tempest-TestVolumeBootPattern-431608932-project-member</nova:user>
Aug 09 23:10:59 user nova-compute[72409]:         <nova:project uuid="b6d29522bd16460eb1edc9fb7918111f">tempest-TestVolumeBootPattern-431608932</nova:project>
Aug 09 23:10:59 user nova-compute[72409]:       </nova:owner>
Aug 09 23:10:59 user nova-compute[72409]:       <nova:ports>
Aug 09 23:10:59 user nova-compute[72409]:         <nova:port uuid="07e73e54-9d79-45d7-970f-2196aa11de52">
Aug 09 23:10:59 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 23:10:59 user nova-compute[72409]:         </nova:port>
Aug 09 23:10:59 user nova-compute[72409]:       </nova:ports>
Aug 09 23:10:59 user nova-compute[72409]:     </nova:instance>
Aug 09 23:10:59 user nova-compute[72409]:   </metadata>
Aug 09 23:10:59 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:10:59 user nova-compute[72409]:     <system>
Aug 09 23:10:59 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:10:59 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:10:59 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:10:59 user nova-compute[72409]:       <entry name="serial">3f9eb677-11aa-4398-87dd-560c055d1c2c</entry>
Aug 09 23:10:59 user nova-compute[72409]:       <entry name="uuid">3f9eb677-11aa-4398-87dd-560c055d1c2c</entry>
Aug 09 23:10:59 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:10:59 user nova-compute[72409]:     </system>
Aug 09 23:10:59 user nova-compute[72409]:   </sysinfo>
Aug 09 23:10:59 user nova-compute[72409]:   <os>
Aug 09 23:10:59 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:10:59 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:10:59 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:10:59 user nova-compute[72409]:   </os>
Aug 09 23:10:59 user nova-compute[72409]:   <features>
Aug 09 23:10:59 user nova-compute[72409]:     <acpi/>
Aug 09 23:10:59 user nova-compute[72409]:     <apic/>
Aug 09 23:10:59 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:10:59 user nova-compute[72409]:   </features>
Aug 09 23:10:59 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:10:59 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:10:59 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:10:59 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:10:59 user nova-compute[72409]:   </clock>
Aug 09 23:10:59 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:10:59 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:10:59 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:10:59 user nova-compute[72409]:   </cpu>
Aug 09 23:10:59 user nova-compute[72409]:   <devices>
Aug 09 23:10:59 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 23:10:59 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:10:59 user nova-compute[72409]:       <source dev="/dev/sdc"/>
Aug 09 23:10:59 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:10:59 user nova-compute[72409]:       <serial>6a9396d3-792d-4f0f-91e3-23b766e62369</serial>
Aug 09 23:10:59 user nova-compute[72409]:     </disk>
Aug 09 23:10:59 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:10:59 user nova-compute[72409]:       <mac address="fa:16:3e:14:1d:21"/>
Aug 09 23:10:59 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:10:59 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:10:59 user nova-compute[72409]:       <target dev="tap07e73e54-9d"/>
Aug 09 23:10:59 user nova-compute[72409]:     </interface>
Aug 09 23:10:59 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:10:59 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/3f9eb677-11aa-4398-87dd-560c055d1c2c/console.log" append="off"/>
Aug 09 23:10:59 user nova-compute[72409]:     </serial>
Aug 09 23:10:59 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:10:59 user nova-compute[72409]:     <video>
Aug 09 23:10:59 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:10:59 user nova-compute[72409]:     </video>
Aug 09 23:10:59 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:10:59 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:10:59 user nova-compute[72409]:     </rng>
Aug 09 23:10:59 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:10:59 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:10:59 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:10:59 user nova-compute[72409]:     </memballoon>
Aug 09 23:10:59 user nova-compute[72409]:   </devices>
Aug 09 23:10:59 user nova-compute[72409]: </domain>
Aug 09 23:10:59 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-996666832',display_name='tempest-TestVolumeBootPattern-server-996666832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-996666832',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1aHN+hYxllL5tuB8HvAlIacEjfYF+w1msAbdktrPPHCcF11JPXwNiBeUP+wL/G+SHuINuvHbsNfaNGa+fgVIlRHvAF1ETChrpZfHrOyvh53hIFQ9t/gmToggpOGTMoMw==',key_name='tempest-TestVolumeBootPattern-982211312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-o68b4tir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:10:50Z,user_data=None,user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=3f9eb677-11aa-4398-87dd-560c055d1c2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07e73e54-9d79-45d7-970f-2196aa11de52", "address": "fa:16:3e:14:1d:21", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e73e54-9d", "ovs_interfaceid": "07e73e54-9d79-45d7-970f-2196aa11de52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "07e73e54-9d79-45d7-970f-2196aa11de52", "address": "fa:16:3e:14:1d:21", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e73e54-9d", "ovs_interfaceid": "07e73e54-9d79-45d7-970f-2196aa11de52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:1d:21,bridge_name='br-int',has_traffic_filtering=True,id=07e73e54-9d79-45d7-970f-2196aa11de52,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e73e54-9d') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG os_vif [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:1d:21,bridge_name='br-int',has_traffic_filtering=True,id=07e73e54-9d79-45d7-970f-2196aa11de52,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e73e54-9d') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07e73e54-9d, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07e73e54-9d, col_values=(('external_ids', {'iface-id': '07e73e54-9d79-45d7-970f-2196aa11de52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:1d:21', 'vm-uuid': '3f9eb677-11aa-4398-87dd-560c055d1c2c'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:00 user nova-compute[72409]: INFO os_vif [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:1d:21,bridge_name='br-int',has_traffic_filtering=True,id=07e73e54-9d79-45d7-970f-2196aa11de52,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e73e54-9d')
Aug 09 23:11:00 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:11:00 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] No VIF found with MAC fa:16:3e:14:1d:21, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:11:01 user nova-compute[72409]: INFO nova.compute.manager [None req-c6f0c891-dca9-40f3-9390-404aa030918f tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Unrescuing
Aug 09 23:11:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6f0c891-dca9-40f3-9390-404aa030918f tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6f0c891-dca9-40f3-9390-404aa030918f tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquired lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c6f0c891-dca9-40f3-9390-404aa030918f tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-0d1c05bc-cb72-48e0-934c-1452e34850f8 req-ed4152b7-5dae-415b-8ffd-835d6d43a2cb service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Received event network-vif-plugged-07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0d1c05bc-cb72-48e0-934c-1452e34850f8 req-ed4152b7-5dae-415b-8ffd-835d6d43a2cb service nova] Acquiring lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0d1c05bc-cb72-48e0-934c-1452e34850f8 req-ed4152b7-5dae-415b-8ffd-835d6d43a2cb service nova] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0d1c05bc-cb72-48e0-934c-1452e34850f8 req-ed4152b7-5dae-415b-8ffd-835d6d43a2cb service nova] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-0d1c05bc-cb72-48e0-934c-1452e34850f8 req-ed4152b7-5dae-415b-8ffd-835d6d43a2cb service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] No waiting events found dispatching network-vif-plugged-07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:11:01 user nova-compute[72409]: WARNING nova.compute.manager [req-0d1c05bc-cb72-48e0-934c-1452e34850f8 req-ed4152b7-5dae-415b-8ffd-835d6d43a2cb service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Received unexpected event network-vif-plugged-07e73e54-9d79-45d7-970f-2196aa11de52 for instance with vm_state building and task_state spawning.
Aug 09 23:11:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c6f0c891-dca9-40f3-9390-404aa030918f tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updating instance_info_cache with network_info: [{"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c6f0c891-dca9-40f3-9390-404aa030918f tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Releasing lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:11:01 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c6f0c891-dca9-40f3-9390-404aa030918f tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'flavor' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:11:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-57849093-5514-4959-9ffd-085d1f3e1c78 req-ca966fdc-892d-4e07-a2c6-cea70b1abdb1 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-unplugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:11:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-57849093-5514-4959-9ffd-085d1f3e1c78 req-ca966fdc-892d-4e07-a2c6-cea70b1abdb1 service nova] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-57849093-5514-4959-9ffd-085d1f3e1c78 req-ca966fdc-892d-4e07-a2c6-cea70b1abdb1 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-57849093-5514-4959-9ffd-085d1f3e1c78 req-ca966fdc-892d-4e07-a2c6-cea70b1abdb1 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-57849093-5514-4959-9ffd-085d1f3e1c78 req-ca966fdc-892d-4e07-a2c6-cea70b1abdb1 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] No waiting events found dispatching network-vif-unplugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:11:02 user nova-compute[72409]: WARNING nova.compute.manager [req-57849093-5514-4959-9ffd-085d1f3e1c78 req-ca966fdc-892d-4e07-a2c6-cea70b1abdb1 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received unexpected event network-vif-unplugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:11:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Instance destroyed successfully.
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622663.5277224, 3f9eb677-11aa-4398-87dd-560c055d1c2c => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:11:03 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] VM Resumed (Lifecycle Event)
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:11:03 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Instance spawned successfully.
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-d7a7c307-1759-4fc0-9869-22f8deb5fb06 req-3af21038-2599-4f97-ba78-aea6affe2dce service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Received event network-vif-plugged-07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d7a7c307-1759-4fc0-9869-22f8deb5fb06 req-3af21038-2599-4f97-ba78-aea6affe2dce service nova] Acquiring lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d7a7c307-1759-4fc0-9869-22f8deb5fb06 req-3af21038-2599-4f97-ba78-aea6affe2dce service nova] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d7a7c307-1759-4fc0-9869-22f8deb5fb06 req-3af21038-2599-4f97-ba78-aea6affe2dce service nova] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.compute.manager [req-d7a7c307-1759-4fc0-9869-22f8deb5fb06 req-3af21038-2599-4f97-ba78-aea6affe2dce service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] No waiting events found dispatching network-vif-plugged-07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:11:03 user nova-compute[72409]: WARNING nova.compute.manager [req-d7a7c307-1759-4fc0-9869-22f8deb5fb06 req-3af21038-2599-4f97-ba78-aea6affe2dce service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Received unexpected event network-vif-plugged-07e73e54-9d79-45d7-970f-2196aa11de52 for instance with vm_state building and task_state spawning.
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:11:03 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622663.5323555, 3f9eb677-11aa-4398-87dd-560c055d1c2c => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:11:03 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] VM Started (Lifecycle Event)
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:11:03 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:11:03 user nova-compute[72409]: INFO nova.compute.manager [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 09 23:11:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:11:03 user nova-compute[72409]: INFO nova.compute.manager [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Took 14.40 seconds to build instance.
Aug 09 23:11:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0bba6f1-feb4-4ea0-bd12-e64f966fa863 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.492s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] No waiting events found dispatching network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:11:04 user nova-compute[72409]: WARNING nova.compute.manager [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received unexpected event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:11:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-changed-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Refreshing instance network info cache due to event network-changed-471b5fc0-921e-4944-b012-6d2cdcb0f246. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] Acquiring lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] Acquired lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG nova.network.neutron [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Refreshing network info cache for port 471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG nova.network.neutron [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updated VIF entry in instance network info cache for port 471b5fc0-921e-4944-b012-6d2cdcb0f246. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG nova.network.neutron [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updating instance_info_cache with network_info: [{"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] Releasing lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-changed-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Refreshing instance network info cache due to event network-changed-471b5fc0-921e-4944-b012-6d2cdcb0f246. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] Acquiring lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] Acquired lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:11:04 user nova-compute[72409]: DEBUG nova.network.neutron [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Refreshing network info cache for port 471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:11:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:05 user nova-compute[72409]: DEBUG nova.network.neutron [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updated VIF entry in instance network info cache for port 471b5fc0-921e-4944-b012-6d2cdcb0f246. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:11:05 user nova-compute[72409]: DEBUG nova.network.neutron [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updating instance_info_cache with network_info: [{"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:11:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] Releasing lock "refresh_cache-a75a5458-8710-425d-9755-dc2dc71f7d5e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:11:05 user nova-compute[72409]: DEBUG nova.compute.manager [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:11:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:05 user nova-compute[72409]: DEBUG nova.compute.manager [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] No waiting events found dispatching network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:11:05 user nova-compute[72409]: WARNING nova.compute.manager [req-5fdaa44f-d420-4f74-8ee5-5a24bd9f7a9e req-9ad3834a-7598-4bdd-bc77-b9731e09f2ab service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received unexpected event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:11:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:11:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:11:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 23:11:05 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] There are 0 instances to clean {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Removed pending event for a75a5458-8710-425d-9755-dc2dc71f7d5e due to event {{(pid=72409) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622666.283544, a75a5458-8710-425d-9755-dc2dc71f7d5e => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:11:06 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] VM Resumed (Lifecycle Event)
Aug 09 23:11:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c6f0c891-dca9-40f3-9390-404aa030918f tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:11:06 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 23:11:06 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622666.2837665, a75a5458-8710-425d-9755-dc2dc71f7d5e => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:11:06 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] VM Started (Lifecycle Event)
Aug 09 23:11:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG nova.compute.manager [req-ecd97de8-3958-481f-8a52-f8d85ab09c9e req-c271a897-44e7-4ee1-9df5-4b57f80ec511 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ecd97de8-3958-481f-8a52-f8d85ab09c9e req-c271a897-44e7-4ee1-9df5-4b57f80ec511 service nova] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ecd97de8-3958-481f-8a52-f8d85ab09c9e req-c271a897-44e7-4ee1-9df5-4b57f80ec511 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ecd97de8-3958-481f-8a52-f8d85ab09c9e req-c271a897-44e7-4ee1-9df5-4b57f80ec511 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG nova.compute.manager [req-ecd97de8-3958-481f-8a52-f8d85ab09c9e req-c271a897-44e7-4ee1-9df5-4b57f80ec511 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] No waiting events found dispatching network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:11:06 user nova-compute[72409]: WARNING nova.compute.manager [req-ecd97de8-3958-481f-8a52-f8d85ab09c9e req-c271a897-44e7-4ee1-9df5-4b57f80ec511 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received unexpected event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 for instance with vm_state active and task_state None.
Aug 09 23:11:06 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:11:09 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:11:09 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8204MB free_disk=25.25824737548828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a75a5458-8710-425d-9755-dc2dc71f7d5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a97303da-cb91-40b9-a7bc-c674365a482e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f9eb677-11aa-4398-87dd-560c055d1c2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing inventories for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating ProviderTree inventory for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing aggregate associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, aggregates: None {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 23:11:09 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing trait associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 23:11:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:10 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:11:10 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:11:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:11:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.715s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Updating instance_info_cache with network_info: [{"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:11:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:11:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:16 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:11:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'flavor' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:26 user nova-compute[72409]: INFO nova.compute.manager [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attaching volume e8b197de-35e4-4e0f-bef6-27372d58ffa8 to /dev/vdb
Aug 09 23:11:26 user nova-compute[72409]: DEBUG os_brick.utils [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaa407c-381c-4245-a902-4fc8ef1e2489]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f237e102-ea73-4d4c-9e53-7b3ce418e006]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce02c8a-c262-49df-adba-07ea094e0c6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b617905f-7975-4ad0-88d0-b2abaf35601a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:11:26 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:11:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bc48c4-485c-4743-abfb-0060fdda38e7]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG os_brick.utils [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:11:26 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Updating existing volume attachment record: 647bdb86-d956-4f79-9db8-65f4db8843a4 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:11:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:34 user nova-compute[72409]: INFO nova.compute.manager [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Detaching volume 114ce0a8-4337-4129-aadf-6f0cf20af81a
Aug 09 23:11:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:35 user nova-compute[72409]: INFO nova.virt.block_device [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Attempting to driver detach volume 114ce0a8-4337-4129-aadf-6f0cf20af81a from mountpoint /dev/vdb
Aug 09 23:11:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Attempting to detach device vdb from instance a75a5458-8710-425d-9755-dc2dc71f7d5e from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:11:35 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:11:35 user nova-compute[72409]:   <source dev="/dev/sde"/>
Aug 09 23:11:35 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:11:35 user nova-compute[72409]:   <serial>114ce0a8-4337-4129-aadf-6f0cf20af81a</serial>
Aug 09 23:11:35 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:11:35 user nova-compute[72409]: </disk>
Aug 09 23:11:35 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:11:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Successfully detached device vdb from instance a75a5458-8710-425d-9755-dc2dc71f7d5e from the persistent domain config.
Aug 09 23:11:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a75a5458-8710-425d-9755-dc2dc71f7d5e from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:11:35 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:11:35 user nova-compute[72409]:   <source dev="/dev/sde"/>
Aug 09 23:11:35 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:11:35 user nova-compute[72409]:   <serial>114ce0a8-4337-4129-aadf-6f0cf20af81a</serial>
Aug 09 23:11:35 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:11:35 user nova-compute[72409]: </disk>
Aug 09 23:11:35 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622695.5220203, a75a5458-8710-425d-9755-dc2dc71f7d5e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:11:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Successfully detached device vdb from instance a75a5458-8710-425d-9755-dc2dc71f7d5e from the live domain config.
Aug 09 23:11:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkfbvMVy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:11:35 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d34029-5fb3-4891-a4e3-d57741abee12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eb5bb0-b9fe-4aad-bc68-9fce491f7d05]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:11:35 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:11:35 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:11:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:11:35 user nova-compute[72409]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a (non-flash)
Aug 09 23:11:35 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:11:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e942e6ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a'): ({'sde'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Removing single pathed devices sde {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6597a80-6c33-42fa-b5f5-b9a226d7d39f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[470970fe-4fd4-4f1d-86fa-bd82546862ef]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Flushing IO for device /dev/sde {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBmfHNTb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:11:35 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a2f441-f5a1-4071-b6b6-5ed2902ed78c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6a7ab2-3425-46dc-8999-d23a303da756]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] SCSI volumes sde have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b198c404-6080-49eb-8ac2-1e7f2b634239]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5315cacc-c186-4f71-b61c-3673365c560c]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a, portal: 172.16.0.220,3260]
Aug 09 23:11:35 user nova-compute[72409]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a, portal: 172.16.0.220,3260] successful.
Aug 09 23:11:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:114ce0a8-4337-4129-aadf-6f0cf20af81a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7085ba-78b4-4a66-b62a-b75129b87c8f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] <== disconnect_volume: return (278ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.168s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:11:35 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:11:35 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1480cfae-4741-46e4-ba64-807509f2bd01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:11:35 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[02707060-29bb-4d9c-8837-ced02b6504b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8] added
Aug 09 23:11:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8075b640-fb02-4bb2-b3f4-69504b3feb1c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8559a4-885c-4f77-8064-31b3f17e63bc]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JBmfHNTb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JBmfHNTb" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[023357f7-2c4d-490b-8e5b-90ef8c03ae18]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JBmfHNTb'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6549cc-15d6-44c5-ab35-06f8d8ad3529]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[69553291-8acf-4c53-84d6-481d572dde63]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:11:35 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:11:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:11:35 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:11:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:11:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd569b2-4275-4d9c-973e-2eb1ad115b35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8, portal: 172.16.0.220,3260]
Aug 09 23:11:36 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8, portal: 172.16.0.220,3260] successful.
Aug 09 23:11:36 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86a0970-727c-4f44-9032-2ba048fac8f9]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[11147101-4e07-417d-9cd4-dddf46ab5cf6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:11:36 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:11:36 user nova-compute[72409]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 (non-flash)
Aug 09 23:11:36 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:11:36 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:11:36 user nova-compute[72409]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 (non-flash)
Aug 09 23:11:36 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4b9dea-a4a8-4e45-bcbd-037177d72bf4]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBmfHNTb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG nova.objects.instance [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'flavor' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:11:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f6adc633-9d01-42ba-83c4-a493a5a33664 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.664s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:11:37 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '23033623734326364', 'path': '/dev/sdd'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:11:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033623734326364', 'path': '/dev/sdd'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:11:37 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'flavor' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:11:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:11:37 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:11:37 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 23:11:37 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:11:37 user nova-compute[72409]:   <serial>e8b197de-35e4-4e0f-bef6-27372d58ffa8</serial>
Aug 09 23:11:37 user nova-compute[72409]: </disk>
Aug 09 23:11:37 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:11:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:11:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:11:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No VIF found with MAC fa:16:3e:1e:a5:0b, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:11:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b7a4fdd5-e817-49b6-84d1-7de8e1d6a503 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.914s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:40 user nova-compute[72409]: INFO nova.compute.manager [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Detaching volume e8b197de-35e4-4e0f-bef6-27372d58ffa8
Aug 09 23:11:40 user nova-compute[72409]: INFO nova.virt.block_device [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attempting to driver detach volume e8b197de-35e4-4e0f-bef6-27372d58ffa8 from mountpoint /dev/vdb
Aug 09 23:11:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Attempting to detach device vdb from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:11:40 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:11:40 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 23:11:40 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:11:40 user nova-compute[72409]:   <serial>e8b197de-35e4-4e0f-bef6-27372d58ffa8</serial>
Aug 09 23:11:40 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:11:40 user nova-compute[72409]: </disk>
Aug 09 23:11:40 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:11:40 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Successfully detached device vdb from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the persistent domain config.
Aug 09 23:11:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:11:40 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:11:40 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 23:11:40 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:11:40 user nova-compute[72409]:   <serial>e8b197de-35e4-4e0f-bef6-27372d58ffa8</serial>
Aug 09 23:11:40 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:11:40 user nova-compute[72409]: </disk>
Aug 09 23:11:40 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622700.6878278, e870efcb-fcb2-4dda-b92a-538fd06f16a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:11:40 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Successfully detached device vdb from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the live domain config.
Aug 09 23:11:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBmfHNTb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:11:40 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d20389-dfeb-42db-bf57-9312300d29fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[95884ff9-d87f-4dd0-8f8c-ff07d71cc8f2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:11:40 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:11:40 user nova-compute[72409]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 (non-flash)
Aug 09 23:11:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:11:40 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:11:40 user nova-compute[72409]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 (non-flash)
Aug 09 23:11:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e94395000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8'): ({'sdd'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Removing single pathed devices sdd {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c84c4f-36f4-4cbf-b8e0-afab37cab413]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5938e121-6f11-46a1-a795-b4f6d6551323]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Flushing IO for device /dev/sdd {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ead4ef3-91d5-40b2-8373-ebcb7caeee9f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f688d65-0c68-4857-b14e-50623f427ac0]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23fb8eb-8049-4bf2-a139-c9aca970e666]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbcb377-1b7b-4a86-a3d7-176765def1a4]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8, portal: 172.16.0.220,3260]
Aug 09 23:11:40 user nova-compute[72409]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8, portal: 172.16.0.220,3260] successful.
Aug 09 23:11:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8b197de-35e4-4e0f-bef6-27372d58ffa8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcebe91d-cdfa-4cc2-a7ea-dabf1282f27b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] <== disconnect_volume: return (271ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:11:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:11:41 user nova-compute[72409]: DEBUG nova.objects.instance [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'flavor' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:11:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-53217b15-131e-4e1d-94c1-1fc16e617672 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.721s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:11:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:56 user nova-compute[72409]: INFO nova.compute.manager [None req-1f126fa7-664c-48ed-9e5c-948cd9698cf1 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Unrescuing
Aug 09 23:11:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1f126fa7-664c-48ed-9e5c-948cd9698cf1 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:11:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1f126fa7-664c-48ed-9e5c-948cd9698cf1 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquired lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:11:56 user nova-compute[72409]: DEBUG nova.network.neutron [None req-1f126fa7-664c-48ed-9e5c-948cd9698cf1 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:11:57 user nova-compute[72409]: DEBUG nova.network.neutron [None req-1f126fa7-664c-48ed-9e5c-948cd9698cf1 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Updating instance_info_cache with network_info: [{"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:11:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1f126fa7-664c-48ed-9e5c-948cd9698cf1 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Releasing lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:11:57 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1f126fa7-664c-48ed-9e5c-948cd9698cf1 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'flavor' on Instance uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:11:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-9a45dc68-c7a9-4cc4-8682-1387e77ad4b1 req-0fc208b1-68e0-4179-b65e-5661994bb342 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-unplugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:11:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a45dc68-c7a9-4cc4-8682-1387e77ad4b1 req-0fc208b1-68e0-4179-b65e-5661994bb342 service nova] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a45dc68-c7a9-4cc4-8682-1387e77ad4b1 req-0fc208b1-68e0-4179-b65e-5661994bb342 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9a45dc68-c7a9-4cc4-8682-1387e77ad4b1 req-0fc208b1-68e0-4179-b65e-5661994bb342 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-9a45dc68-c7a9-4cc4-8682-1387e77ad4b1 req-0fc208b1-68e0-4179-b65e-5661994bb342 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] No waiting events found dispatching network-vif-unplugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:11:57 user nova-compute[72409]: WARNING nova.compute.manager [req-9a45dc68-c7a9-4cc4-8682-1387e77ad4b1 req-0fc208b1-68e0-4179-b65e-5661994bb342 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received unexpected event network-vif-unplugged-7854b9ac-e7ec-486d-9e13-de3581f75379 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:11:58 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Instance destroyed successfully.
Aug 09 23:11:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] No waiting events found dispatching network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:11:59 user nova-compute[72409]: WARNING nova.compute.manager [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received unexpected event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:11:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] No waiting events found dispatching network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:11:59 user nova-compute[72409]: WARNING nova.compute.manager [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received unexpected event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:11:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:11:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] No waiting events found dispatching network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:11:59 user nova-compute[72409]: WARNING nova.compute.manager [req-7e07a60c-be90-48ad-bf8a-3b420d86e367 req-14ff98f9-349f-49a5-a14b-d3da661c0cf9 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received unexpected event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:12:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Removed pending event for 8f7e2151-3d32-4ec8-9903-f5f284879ae0 due to event {{(pid=72409) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 23:12:01 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622721.5190077, 8f7e2151-3d32-4ec8-9903-f5f284879ae0 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:12:01 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] VM Resumed (Lifecycle Event)
Aug 09 23:12:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1f126fa7-664c-48ed-9e5c-948cd9698cf1 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:12:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:12:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:12:01 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 23:12:01 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622721.5203042, 8f7e2151-3d32-4ec8-9903-f5f284879ae0 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:12:01 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] VM Started (Lifecycle Event)
Aug 09 23:12:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:12:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:12:01 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:12:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:12:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:12:06 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:12:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:12:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:12:09 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:12:09 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:12:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8124MB free_disk=25.247299194335938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a75a5458-8710-425d-9755-dc2dc71f7d5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a97303da-cb91-40b9-a7bc-c674365a482e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 3f9eb677-11aa-4398-87dd-560c055d1c2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:12:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:10 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:12:10 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:12:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:12:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:12:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:12:10 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:12:11 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Updating instance_info_cache with network_info: [{"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:12:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:12:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:12:11 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:12:11 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:12:11 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:12:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:12:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:12:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:25 user nova-compute[72409]: INFO nova.compute.manager [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Terminating instance
Aug 09 23:12:25 user nova-compute[72409]: DEBUG nova.compute.manager [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-cb197655-939c-4aaf-8ae8-4575773e7023 req-4660cfe9-31f7-489f-b39a-783e0d4d5e46 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-unplugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cb197655-939c-4aaf-8ae8-4575773e7023 req-4660cfe9-31f7-489f-b39a-783e0d4d5e46 service nova] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cb197655-939c-4aaf-8ae8-4575773e7023 req-4660cfe9-31f7-489f-b39a-783e0d4d5e46 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-cb197655-939c-4aaf-8ae8-4575773e7023 req-4660cfe9-31f7-489f-b39a-783e0d4d5e46 service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-cb197655-939c-4aaf-8ae8-4575773e7023 req-4660cfe9-31f7-489f-b39a-783e0d4d5e46 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] No waiting events found dispatching network-vif-unplugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:12:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-cb197655-939c-4aaf-8ae8-4575773e7023 req-4660cfe9-31f7-489f-b39a-783e0d4d5e46 service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-unplugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:12:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Instance destroyed successfully.
Aug 09 23:12:26 user nova-compute[72409]: DEBUG nova.objects.instance [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lazy-loading 'resources' on Instance uuid a75a5458-8710-425d-9755-dc2dc71f7d5e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:12:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1160653917',display_name='tempest-ServerStableDeviceRescueTest-server-1160653917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1160653917',id=35,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnf38V2OuD96vJjhFZoJ5nm87MXR7+3d+L+cKtAMz4KfRBBR78yAxB8Mtao/xryU8hisujP277ogXOA2H+zoEvWtKW+FemUZhOHblLHBOi+JqiPbTlvQU0hppvOCFHjfA==',key_name='tempest-keypair-451174164',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='409bb8521e054a8aa8d4eff42d529f49',ramdisk_id='',reservation_id='r-a1mshumj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1483667953',owner_user_name='tempest-ServerStableDeviceRescueTest-1483667953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:11:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feb2365fd49a41269597b3834e2ab2b6',uuid=a75a5458-8710-425d-9755-dc2dc71f7d5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:12:26 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Converting VIF {"id": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "address": "fa:16:3e:15:28:f7", "network": {"id": "8d9e93ae-10cf-42b4-a277-297161eb3559", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-783490936-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "409bb8521e054a8aa8d4eff42d529f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5fc0-92", "ovs_interfaceid": "471b5fc0-921e-4944-b012-6d2cdcb0f246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:12:26 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=471b5fc0-921e-4944-b012-6d2cdcb0f246,network=Network(8d9e93ae-10cf-42b4-a277-297161eb3559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5fc0-92') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:12:26 user nova-compute[72409]: DEBUG os_vif [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=471b5fc0-921e-4944-b012-6d2cdcb0f246,network=Network(8d9e93ae-10cf-42b4-a277-297161eb3559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5fc0-92') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:12:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap471b5fc0-92, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:12:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:12:26 user nova-compute[72409]: INFO os_vif [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:28:f7,bridge_name='br-int',has_traffic_filtering=True,id=471b5fc0-921e-4944-b012-6d2cdcb0f246,network=Network(8d9e93ae-10cf-42b4-a277-297161eb3559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5fc0-92')
Aug 09 23:12:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Deleting instance files /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e_del
Aug 09 23:12:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Deletion of /opt/stack/data/nova/instances/a75a5458-8710-425d-9755-dc2dc71f7d5e_del complete
Aug 09 23:12:26 user nova-compute[72409]: INFO nova.compute.manager [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 23:12:26 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:12:26 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:12:26 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:12:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:27 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:12:27 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Took 1.11 seconds to deallocate network for instance.
Aug 09 23:12:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:27 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:12:27 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:12:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:27 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Deleted allocations for instance a75a5458-8710-425d-9755-dc2dc71f7d5e
Aug 09 23:12:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-246e15dd-768e-4798-841c-07bf79953fe0 tempest-ServerStableDeviceRescueTest-1483667953 tempest-ServerStableDeviceRescueTest-1483667953-project-member] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.374s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-6de6b37d-735b-412f-9d87-103c462c3a15 req-734326e7-ede5-4860-af13-f378f6e003aa service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:12:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6de6b37d-735b-412f-9d87-103c462c3a15 req-734326e7-ede5-4860-af13-f378f6e003aa service nova] Acquiring lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6de6b37d-735b-412f-9d87-103c462c3a15 req-734326e7-ede5-4860-af13-f378f6e003aa service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6de6b37d-735b-412f-9d87-103c462c3a15 req-734326e7-ede5-4860-af13-f378f6e003aa service nova] Lock "a75a5458-8710-425d-9755-dc2dc71f7d5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-6de6b37d-735b-412f-9d87-103c462c3a15 req-734326e7-ede5-4860-af13-f378f6e003aa service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] No waiting events found dispatching network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:12:27 user nova-compute[72409]: WARNING nova.compute.manager [req-6de6b37d-735b-412f-9d87-103c462c3a15 req-734326e7-ede5-4860-af13-f378f6e003aa service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received unexpected event network-vif-plugged-471b5fc0-921e-4944-b012-6d2cdcb0f246 for instance with vm_state deleted and task_state None.
Aug 09 23:12:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-6de6b37d-735b-412f-9d87-103c462c3a15 req-734326e7-ede5-4860-af13-f378f6e003aa service nova] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Received event network-vif-deleted-471b5fc0-921e-4944-b012-6d2cdcb0f246 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:12:28 user nova-compute[72409]: INFO nova.compute.claims [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Claim successful on node user
Aug 09 23:12:28 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:12:28 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:12:28 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG nova.policy [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b61d55e8ee64a29932fdd5e96a1da9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b705695877154faabd0c75185ad73491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:12:28 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Creating image(s)
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "/opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "/opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk 1073741824" returned: 0 in 0.054s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Successfully created port: eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Cannot resize image /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lazy-loading 'migration_context' on Instance uuid 5a24033f-5bf1-4747-a8f4-3edc32600a9a {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Ensure instance console log exists: /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Successfully updated port: eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquired lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-1eef58a2-2523-484e-a9ae-ede2e2fd468e req-31e1038d-5de2-4981-a1bb-545875fcfb61 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received event network-changed-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-1eef58a2-2523-484e-a9ae-ede2e2fd468e req-31e1038d-5de2-4981-a1bb-545875fcfb61 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Refreshing instance network info cache due to event network-changed-eb627aae-6309-48cb-8145-a9e530cc8d39. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1eef58a2-2523-484e-a9ae-ede2e2fd468e req-31e1038d-5de2-4981-a1bb-545875fcfb61 service nova] Acquiring lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Updating instance_info_cache with network_info: [{"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Releasing lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Instance network_info: |[{"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1eef58a2-2523-484e-a9ae-ede2e2fd468e req-31e1038d-5de2-4981-a1bb-545875fcfb61 service nova] Acquired lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-1eef58a2-2523-484e-a9ae-ede2e2fd468e req-31e1038d-5de2-4981-a1bb-545875fcfb61 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Refreshing network info cache for port eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Start _get_guest_xml network_info=[{"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:12:30 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:12:30 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1468976205',display_name='tempest-TestStampPattern-server-1468976205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1468976205',id=42,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACqTN5JNJboA9fuy5/UTb+uTv5M7CNRxzTTBTq5qMrCSjkVTX26zZ8ycWZWQgsh8TUujt/vkEhg0GyHg4LEyMi1LYTUUsuY0vv4GJj3S4KwV8eNTp0vV4370y1nJlwPHw==',key_name='tempest-TestStampPattern-1134071202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b705695877154faabd0c75185ad73491',ramdisk_id='',reservation_id='r-0zrvv0a5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-322079569',owner_user_name='tempest-TestStampPattern-322079569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:12:29Z,user_data=None,user_id='4b61d55e8ee64a29932fdd5e96a1da9a',uuid=5a24033f-5bf1-4747-a8f4-3edc32600a9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Converting VIF {"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:b5:d2,bridge_name='br-int',has_traffic_filtering=True,id=eb627aae-6309-48cb-8145-a9e530cc8d39,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb627aae-63') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a24033f-5bf1-4747-a8f4-3edc32600a9a {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:12:30 user nova-compute[72409]:   <uuid>5a24033f-5bf1-4747-a8f4-3edc32600a9a</uuid>
Aug 09 23:12:30 user nova-compute[72409]:   <name>instance-0000002a</name>
Aug 09 23:12:30 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:12:30 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:12:30 user nova-compute[72409]:   <metadata>
Aug 09 23:12:30 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:12:30 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:12:30 user nova-compute[72409]:       <nova:name>tempest-TestStampPattern-server-1468976205</nova:name>
Aug 09 23:12:30 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:12:30</nova:creationTime>
Aug 09 23:12:30 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:12:30 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:12:30 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:12:30 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:12:30 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:12:30 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:12:30 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:12:30 user nova-compute[72409]:       <nova:owner>
Aug 09 23:12:30 user nova-compute[72409]:         <nova:user uuid="4b61d55e8ee64a29932fdd5e96a1da9a">tempest-TestStampPattern-322079569-project-member</nova:user>
Aug 09 23:12:30 user nova-compute[72409]:         <nova:project uuid="b705695877154faabd0c75185ad73491">tempest-TestStampPattern-322079569</nova:project>
Aug 09 23:12:30 user nova-compute[72409]:       </nova:owner>
Aug 09 23:12:30 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:12:30 user nova-compute[72409]:       <nova:ports>
Aug 09 23:12:30 user nova-compute[72409]:         <nova:port uuid="eb627aae-6309-48cb-8145-a9e530cc8d39">
Aug 09 23:12:30 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 23:12:30 user nova-compute[72409]:         </nova:port>
Aug 09 23:12:30 user nova-compute[72409]:       </nova:ports>
Aug 09 23:12:30 user nova-compute[72409]:     </nova:instance>
Aug 09 23:12:30 user nova-compute[72409]:   </metadata>
Aug 09 23:12:30 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:12:30 user nova-compute[72409]:     <system>
Aug 09 23:12:30 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:12:30 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:12:30 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:12:30 user nova-compute[72409]:       <entry name="serial">5a24033f-5bf1-4747-a8f4-3edc32600a9a</entry>
Aug 09 23:12:30 user nova-compute[72409]:       <entry name="uuid">5a24033f-5bf1-4747-a8f4-3edc32600a9a</entry>
Aug 09 23:12:30 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:12:30 user nova-compute[72409]:     </system>
Aug 09 23:12:30 user nova-compute[72409]:   </sysinfo>
Aug 09 23:12:30 user nova-compute[72409]:   <os>
Aug 09 23:12:30 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:12:30 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:12:30 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:12:30 user nova-compute[72409]:   </os>
Aug 09 23:12:30 user nova-compute[72409]:   <features>
Aug 09 23:12:30 user nova-compute[72409]:     <acpi/>
Aug 09 23:12:30 user nova-compute[72409]:     <apic/>
Aug 09 23:12:30 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:12:30 user nova-compute[72409]:   </features>
Aug 09 23:12:30 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:12:30 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:12:30 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:12:30 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:12:30 user nova-compute[72409]:   </clock>
Aug 09 23:12:30 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:12:30 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:12:30 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:12:30 user nova-compute[72409]:   </cpu>
Aug 09 23:12:30 user nova-compute[72409]:   <devices>
Aug 09 23:12:30 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:12:30 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:12:30 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk"/>
Aug 09 23:12:30 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:12:30 user nova-compute[72409]:     </disk>
Aug 09 23:12:30 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:12:30 user nova-compute[72409]:       <mac address="fa:16:3e:91:b5:d2"/>
Aug 09 23:12:30 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:12:30 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:12:30 user nova-compute[72409]:       <target dev="tapeb627aae-63"/>
Aug 09 23:12:30 user nova-compute[72409]:     </interface>
Aug 09 23:12:30 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:12:30 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/console.log" append="off"/>
Aug 09 23:12:30 user nova-compute[72409]:     </serial>
Aug 09 23:12:30 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:12:30 user nova-compute[72409]:     <video>
Aug 09 23:12:30 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:12:30 user nova-compute[72409]:     </video>
Aug 09 23:12:30 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:12:30 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:12:30 user nova-compute[72409]:     </rng>
Aug 09 23:12:30 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:12:30 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:12:30 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:12:30 user nova-compute[72409]:     </memballoon>
Aug 09 23:12:30 user nova-compute[72409]:   </devices>
Aug 09 23:12:30 user nova-compute[72409]: </domain>
Aug 09 23:12:30 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1468976205',display_name='tempest-TestStampPattern-server-1468976205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1468976205',id=42,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACqTN5JNJboA9fuy5/UTb+uTv5M7CNRxzTTBTq5qMrCSjkVTX26zZ8ycWZWQgsh8TUujt/vkEhg0GyHg4LEyMi1LYTUUsuY0vv4GJj3S4KwV8eNTp0vV4370y1nJlwPHw==',key_name='tempest-TestStampPattern-1134071202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b705695877154faabd0c75185ad73491',ramdisk_id='',reservation_id='r-0zrvv0a5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-322079569',owner_user_name='tempest-TestStampPattern-322079569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:12:29Z,user_data=None,user_id='4b61d55e8ee64a29932fdd5e96a1da9a',uuid=5a24033f-5bf1-4747-a8f4-3edc32600a9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Converting VIF {"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:b5:d2,bridge_name='br-int',has_traffic_filtering=True,id=eb627aae-6309-48cb-8145-a9e530cc8d39,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb627aae-63') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG os_vif [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:b5:d2,bridge_name='br-int',has_traffic_filtering=True,id=eb627aae-6309-48cb-8145-a9e530cc8d39,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb627aae-63') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb627aae-63, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb627aae-63, col_values=(('external_ids', {'iface-id': 'eb627aae-6309-48cb-8145-a9e530cc8d39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:b5:d2', 'vm-uuid': '5a24033f-5bf1-4747-a8f4-3edc32600a9a'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:30 user nova-compute[72409]: INFO os_vif [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:b5:d2,bridge_name='br-int',has_traffic_filtering=True,id=eb627aae-6309-48cb-8145-a9e530cc8d39,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb627aae-63')
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:12:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] No VIF found with MAC fa:16:3e:91:b5:d2, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:12:31 user nova-compute[72409]: DEBUG nova.network.neutron [req-1eef58a2-2523-484e-a9ae-ede2e2fd468e req-31e1038d-5de2-4981-a1bb-545875fcfb61 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Updated VIF entry in instance network info cache for port eb627aae-6309-48cb-8145-a9e530cc8d39. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:12:31 user nova-compute[72409]: DEBUG nova.network.neutron [req-1eef58a2-2523-484e-a9ae-ede2e2fd468e req-31e1038d-5de2-4981-a1bb-545875fcfb61 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Updating instance_info_cache with network_info: [{"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:12:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1eef58a2-2523-484e-a9ae-ede2e2fd468e req-31e1038d-5de2-4981-a1bb-545875fcfb61 service nova] Releasing lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:12:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-90364bc2-15be-4bc7-96ac-a7e6b9ac61c3 req-3a23121d-7ec4-4a3e-810c-8118e5e52a35 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received event network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:12:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-90364bc2-15be-4bc7-96ac-a7e6b9ac61c3 req-3a23121d-7ec4-4a3e-810c-8118e5e52a35 service nova] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-90364bc2-15be-4bc7-96ac-a7e6b9ac61c3 req-3a23121d-7ec4-4a3e-810c-8118e5e52a35 service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-90364bc2-15be-4bc7-96ac-a7e6b9ac61c3 req-3a23121d-7ec4-4a3e-810c-8118e5e52a35 service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-90364bc2-15be-4bc7-96ac-a7e6b9ac61c3 req-3a23121d-7ec4-4a3e-810c-8118e5e52a35 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] No waiting events found dispatching network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:12:32 user nova-compute[72409]: WARNING nova.compute.manager [req-90364bc2-15be-4bc7-96ac-a7e6b9ac61c3 req-3a23121d-7ec4-4a3e-810c-8118e5e52a35 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received unexpected event network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 for instance with vm_state building and task_state spawning.
Aug 09 23:12:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622754.1782641, 5a24033f-5bf1-4747-a8f4-3edc32600a9a => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:12:34 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] VM Resumed (Lifecycle Event)
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.objects.instance [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'flavor' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:12:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Instance spawned successfully.
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:34 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622754.1815083, 5a24033f-5bf1-4747-a8f4-3edc32600a9a => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:12:34 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] VM Started (Lifecycle Event)
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:12:34 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:12:34 user nova-compute[72409]: INFO nova.compute.manager [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Took 5.61 seconds to spawn the instance on the hypervisor.
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.compute.manager [req-b9e745be-7331-4948-be45-3e12b2bd64f0 req-c147963a-cbd7-47bb-ad8c-2b904022a79b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received event network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b9e745be-7331-4948-be45-3e12b2bd64f0 req-c147963a-cbd7-47bb-ad8c-2b904022a79b service nova] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b9e745be-7331-4948-be45-3e12b2bd64f0 req-c147963a-cbd7-47bb-ad8c-2b904022a79b service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b9e745be-7331-4948-be45-3e12b2bd64f0 req-c147963a-cbd7-47bb-ad8c-2b904022a79b service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.compute.manager [req-b9e745be-7331-4948-be45-3e12b2bd64f0 req-c147963a-cbd7-47bb-ad8c-2b904022a79b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] No waiting events found dispatching network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:12:34 user nova-compute[72409]: WARNING nova.compute.manager [req-b9e745be-7331-4948-be45-3e12b2bd64f0 req-c147963a-cbd7-47bb-ad8c-2b904022a79b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received unexpected event network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 for instance with vm_state building and task_state spawning.
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:34 user nova-compute[72409]: INFO nova.compute.manager [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attaching volume 3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b to /dev/vdb
Aug 09 23:12:34 user nova-compute[72409]: INFO nova.compute.manager [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Took 6.24 seconds to build instance.
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a08e310a-370e-4400-8b44-fdc35dd4968a tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.348s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG os_brick.utils [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c059c893-d071-4810-b213-e5d3f28d6e78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33dc1c0-98e4-4425-b189-0e4a73fe608a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33466bb-1f10-400f-bbd6-dd6fd956244c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e40118-57f3-4d12-87fe-b2d3a51d8902]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:12:34 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:12:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae26c5f4-bc55-46f9-91dd-9c04adef9d09]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG os_brick.utils [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:12:34 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Updating existing volume attachment record: 9048c30e-06c9-4bc1-a345-406453637582 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:12:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:41 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622746.2845604, a75a5458-8710-425d-9755-dc2dc71f7d5e => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:12:41 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] VM Stopped (Lifecycle Event)
Aug 09 23:12:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c53a39a8-c3d3-4e02-91b5-5201143869c3 None None] [instance: a75a5458-8710-425d-9755-dc2dc71f7d5e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:12:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-12a38d36-bec2-4a36-aa50-163ce1932018 req-6cc19766-f13c-4bb6-a17e-77f383bcd858 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Received event network-changed-07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:12:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-12a38d36-bec2-4a36-aa50-163ce1932018 req-6cc19766-f13c-4bb6-a17e-77f383bcd858 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Refreshing instance network info cache due to event network-changed-07e73e54-9d79-45d7-970f-2196aa11de52. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:12:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-12a38d36-bec2-4a36-aa50-163ce1932018 req-6cc19766-f13c-4bb6-a17e-77f383bcd858 service nova] Acquiring lock "refresh_cache-3f9eb677-11aa-4398-87dd-560c055d1c2c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:12:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-12a38d36-bec2-4a36-aa50-163ce1932018 req-6cc19766-f13c-4bb6-a17e-77f383bcd858 service nova] Acquired lock "refresh_cache-3f9eb677-11aa-4398-87dd-560c055d1c2c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:12:41 user nova-compute[72409]: DEBUG nova.network.neutron [req-12a38d36-bec2-4a36-aa50-163ce1932018 req-6cc19766-f13c-4bb6-a17e-77f383bcd858 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Refreshing network info cache for port 07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:12:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:42 user nova-compute[72409]: DEBUG nova.network.neutron [req-12a38d36-bec2-4a36-aa50-163ce1932018 req-6cc19766-f13c-4bb6-a17e-77f383bcd858 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Updated VIF entry in instance network info cache for port 07e73e54-9d79-45d7-970f-2196aa11de52. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:12:42 user nova-compute[72409]: DEBUG nova.network.neutron [req-12a38d36-bec2-4a36-aa50-163ce1932018 req-6cc19766-f13c-4bb6-a17e-77f383bcd858 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Updating instance_info_cache with network_info: [{"id": "07e73e54-9d79-45d7-970f-2196aa11de52", "address": "fa:16:3e:14:1d:21", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e73e54-9d", "ovs_interfaceid": "07e73e54-9d79-45d7-970f-2196aa11de52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:12:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-12a38d36-bec2-4a36-aa50-163ce1932018 req-6cc19766-f13c-4bb6-a17e-77f383bcd858 service nova] Releasing lock "refresh_cache-3f9eb677-11aa-4398-87dd-560c055d1c2c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:12:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "3f9eb677-11aa-4398-87dd-560c055d1c2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:42 user nova-compute[72409]: INFO nova.compute.manager [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Terminating instance
Aug 09 23:12:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:12:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-3530aded-dee7-4735-9963-5fce30696fc7 req-128995e6-8419-44cc-b31e-5fec4c255153 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Received event network-vif-unplugged-07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3530aded-dee7-4735-9963-5fce30696fc7 req-128995e6-8419-44cc-b31e-5fec4c255153 service nova] Acquiring lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3530aded-dee7-4735-9963-5fce30696fc7 req-128995e6-8419-44cc-b31e-5fec4c255153 service nova] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3530aded-dee7-4735-9963-5fce30696fc7 req-128995e6-8419-44cc-b31e-5fec4c255153 service nova] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-3530aded-dee7-4735-9963-5fce30696fc7 req-128995e6-8419-44cc-b31e-5fec4c255153 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] No waiting events found dispatching network-vif-unplugged-07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-3530aded-dee7-4735-9963-5fce30696fc7 req-128995e6-8419-44cc-b31e-5fec4c255153 service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Received event network-vif-unplugged-07e73e54-9d79-45d7-970f-2196aa11de52 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DnojcrbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:12:43 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:12:43 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:12:43 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1687c56-6d1f-4335-a8a0-fe47a26456f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:12:43 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb614cb-f2b8-4917-8d3d-f7035cf79cc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b] added
Aug 09 23:12:43 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-24a82e5b-1afe-4bff-ae9c-e3a76c84a592 req-930ebe27-3cb2-4b49-b4be-ae513314fcef service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Received event network-changed-07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-24a82e5b-1afe-4bff-ae9c-e3a76c84a592 req-930ebe27-3cb2-4b49-b4be-ae513314fcef service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Refreshing instance network info cache due to event network-changed-07e73e54-9d79-45d7-970f-2196aa11de52. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-24a82e5b-1afe-4bff-ae9c-e3a76c84a592 req-930ebe27-3cb2-4b49-b4be-ae513314fcef service nova] Acquiring lock "refresh_cache-3f9eb677-11aa-4398-87dd-560c055d1c2c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-24a82e5b-1afe-4bff-ae9c-e3a76c84a592 req-930ebe27-3cb2-4b49-b4be-ae513314fcef service nova] Acquired lock "refresh_cache-3f9eb677-11aa-4398-87dd-560c055d1c2c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG nova.network.neutron [req-24a82e5b-1afe-4bff-ae9c-e3a76c84a592 req-930ebe27-3cb2-4b49-b4be-ae513314fcef service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Refreshing network info cache for port 07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c61ad56-f591-4af3-9b46-bbf5fb23b356]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:43 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Instance destroyed successfully.
Aug 09 23:12:43 user nova-compute[72409]: DEBUG nova.objects.instance [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lazy-loading 'resources' on Instance uuid 3f9eb677-11aa-4398-87dd-560c055d1c2c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb36c7b-cf5f-4a27-bc40-0dbb056ffdb3]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-996666832',display_name='tempest-TestVolumeBootPattern-server-996666832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-996666832',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1aHN+hYxllL5tuB8HvAlIacEjfYF+w1msAbdktrPPHCcF11JPXwNiBeUP+wL/G+SHuINuvHbsNfaNGa+fgVIlRHvAF1ETChrpZfHrOyvh53hIFQ9t/gmToggpOGTMoMw==',key_name='tempest-TestVolumeBootPattern-982211312',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:11:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-o68b4tir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:11:04Z,user_data=None,user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=3f9eb677-11aa-4398-87dd-560c055d1c2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07e73e54-9d79-45d7-970f-2196aa11de52", "address": "fa:16:3e:14:1d:21", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e73e54-9d", "ovs_interfaceid": "07e73e54-9d79-45d7-970f-2196aa11de52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "07e73e54-9d79-45d7-970f-2196aa11de52", "address": "fa:16:3e:14:1d:21", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e73e54-9d", "ovs_interfaceid": "07e73e54-9d79-45d7-970f-2196aa11de52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:1d:21,bridge_name='br-int',has_traffic_filtering=True,id=07e73e54-9d79-45d7-970f-2196aa11de52,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e73e54-9d') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_vif [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:1d:21,bridge_name='br-int',has_traffic_filtering=True,id=07e73e54-9d79-45d7-970f-2196aa11de52,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e73e54-9d') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DnojcrbI {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07e73e54-9d, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:43 user nova-compute[72409]: INFO os_vif [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:1d:21,bridge_name='br-int',has_traffic_filtering=True,id=07e73e54-9d79-45d7-970f-2196aa11de52,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07e73e54-9d')
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DnojcrbI" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[281d6fa5-0f09-47b9-b3c6-417e237ddece]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DnojcrbI'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NStQZCam', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:12:43 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dd241f-3258-4007-b2fd-ca6e7ca2d86d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2310463d-86f4-45d7-9c1e-f534b5daf222]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:12:43 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:12:43 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:12:43 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:12:43 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b639e93-bc73-48af-a3cf-3a2577507a22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b, portal: 172.16.0.220,3260]
Aug 09 23:12:43 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b, portal: 172.16.0.220,3260] successful.
Aug 09 23:12:43 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b50bda-9a80-4389-b96c-d77ac04cc136]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b8aecf-f2f1-45bd-887e-cb7f8dbe276f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:12:43 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:12:43 user nova-compute[72409]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b (non-flash)
Aug 09 23:12:43 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:12:43 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:12:43 user nova-compute[72409]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b (non-flash)
Aug 09 23:12:43 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6208c9-32fb-4edd-b0e1-ce71d1a1bcd5]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:43 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG nova.network.neutron [req-24a82e5b-1afe-4bff-ae9c-e3a76c84a592 req-930ebe27-3cb2-4b49-b4be-ae513314fcef service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Updated VIF entry in instance network info cache for port 07e73e54-9d79-45d7-970f-2196aa11de52. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG nova.network.neutron [req-24a82e5b-1afe-4bff-ae9c-e3a76c84a592 req-930ebe27-3cb2-4b49-b4be-ae513314fcef service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Updating instance_info_cache with network_info: [{"id": "07e73e54-9d79-45d7-970f-2196aa11de52", "address": "fa:16:3e:14:1d:21", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07e73e54-9d", "ovs_interfaceid": "07e73e54-9d79-45d7-970f-2196aa11de52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-24a82e5b-1afe-4bff-ae9c-e3a76c84a592 req-930ebe27-3cb2-4b49-b4be-ae513314fcef service nova] Releasing lock "refresh_cache-3f9eb677-11aa-4398-87dd-560c055d1c2c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DnojcrbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26538346538656364', 'path': '/dev/sdd'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538346538656364', 'path': '/dev/sdd'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.220s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG nova.objects.instance [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'flavor' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e8f24a-a55d-4564-bf5b-2ad5045f3916]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:12:44 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:12:44 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 23:12:44 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:12:44 user nova-compute[72409]:   <serial>3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b</serial>
Aug 09 23:12:44 user nova-compute[72409]: </disk>
Aug 09 23:12:44 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2269b55b-b0c6-474d-9559-42147f20c618]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:12:44 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:12:44 user nova-compute[72409]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b (non-flash)
Aug 09 23:12:44 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:12:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:12:44 user nova-compute[72409]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 (non-flash)
Aug 09 23:12:44 user nova-compute[72409]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b (non-flash)
Aug 09 23:12:44 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e8440f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e750bc-c342-44b0-9a1c-72e871fdaa14]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89cb35a-af84-43ed-84d6-08cfa376f992]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6158d2-9ef3-43c3-8497-1a4f554b7e25]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.170s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b5ccba-f634-45de-8bd4-89102bd3a981]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27962d6-a7f6-4199-bef3-a84f3380b70b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea42571-9137-419e-8b9d-003f2902db1c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369, portal: 172.16.0.220,3260]
Aug 09 23:12:45 user nova-compute[72409]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369, portal: 172.16.0.220,3260] successful.
Aug 09 23:12:45 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9396d3-792d-4f0f-91e3-23b766e62369 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e8b240-b10a-40be-80c5-3de9874d85d1]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== disconnect_volume: return (1641ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:12:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Deleting instance files /opt/stack/data/nova/instances/3f9eb677-11aa-4398-87dd-560c055d1c2c_del
Aug 09 23:12:45 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Deletion of /opt/stack/data/nova/instances/3f9eb677-11aa-4398-87dd-560c055d1c2c_del complete
Aug 09 23:12:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] No VIF found with MAC fa:16:3e:1e:a5:0b, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-606b7371-563a-41c0-8f54-8e1d289b8dfe req-7d3f8f7a-54df-492f-89be-325cc1c3ee5e service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Received event network-vif-plugged-07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-606b7371-563a-41c0-8f54-8e1d289b8dfe req-7d3f8f7a-54df-492f-89be-325cc1c3ee5e service nova] Acquiring lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-606b7371-563a-41c0-8f54-8e1d289b8dfe req-7d3f8f7a-54df-492f-89be-325cc1c3ee5e service nova] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-606b7371-563a-41c0-8f54-8e1d289b8dfe req-7d3f8f7a-54df-492f-89be-325cc1c3ee5e service nova] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-606b7371-563a-41c0-8f54-8e1d289b8dfe req-7d3f8f7a-54df-492f-89be-325cc1c3ee5e service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] No waiting events found dispatching network-vif-plugged-07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:12:45 user nova-compute[72409]: WARNING nova.compute.manager [req-606b7371-563a-41c0-8f54-8e1d289b8dfe req-7d3f8f7a-54df-492f-89be-325cc1c3ee5e service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Received unexpected event network-vif-plugged-07e73e54-9d79-45d7-970f-2196aa11de52 for instance with vm_state active and task_state deleting.
Aug 09 23:12:45 user nova-compute[72409]: INFO nova.compute.manager [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Took 2.62 seconds to destroy the instance on the hypervisor.
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bfdf6089-cfb0-4e97-ba1c-a40197c0690f tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.163s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:45 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:12:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-0f3913a7-bdf8-4bea-9f86-82d73fbbd1af req-63a80395-f426-4e7a-873e-10e3dd4cb79d service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Received event network-vif-deleted-07e73e54-9d79-45d7-970f-2196aa11de52 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:12:46 user nova-compute[72409]: INFO nova.compute.manager [req-0f3913a7-bdf8-4bea-9f86-82d73fbbd1af req-63a80395-f426-4e7a-873e-10e3dd4cb79d service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Neutron deleted interface 07e73e54-9d79-45d7-970f-2196aa11de52; detaching it from the instance and deleting it from the info cache
Aug 09 23:12:46 user nova-compute[72409]: DEBUG nova.network.neutron [req-0f3913a7-bdf8-4bea-9f86-82d73fbbd1af req-63a80395-f426-4e7a-873e-10e3dd4cb79d service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:12:46 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Took 0.55 seconds to deallocate network for instance.
Aug 09 23:12:46 user nova-compute[72409]: DEBUG nova.compute.manager [req-0f3913a7-bdf8-4bea-9f86-82d73fbbd1af req-63a80395-f426-4e7a-873e-10e3dd4cb79d service nova] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Detach interface failed, port_id=07e73e54-9d79-45d7-970f-2196aa11de52, reason: Instance 3f9eb677-11aa-4398-87dd-560c055d1c2c could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 23:12:46 user nova-compute[72409]: INFO nova.compute.manager [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Took 0.71 seconds to detach 1 volumes for instance.
Aug 09 23:12:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:46 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:12:46 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:12:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:47 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Deleted allocations for instance 3f9eb677-11aa-4398-87dd-560c055d1c2c
Aug 09 23:12:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-f0db6cb4-8eb1-404e-a7fe-e93530223da0 tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "3f9eb677-11aa-4398-87dd-560c055d1c2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.340s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:12:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:12:47 user nova-compute[72409]: INFO nova.compute.manager [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Detaching volume 3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b
Aug 09 23:12:47 user nova-compute[72409]: INFO nova.virt.block_device [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Attempting to driver detach volume 3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b from mountpoint /dev/vdb
Aug 09 23:12:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Attempting to detach device vdb from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:12:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:12:47 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:12:47 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 23:12:47 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:12:47 user nova-compute[72409]:   <serial>3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b</serial>
Aug 09 23:12:47 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:12:47 user nova-compute[72409]: </disk>
Aug 09 23:12:47 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:12:47 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Successfully detached device vdb from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the persistent domain config.
Aug 09 23:12:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:12:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:12:47 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:12:47 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 23:12:47 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:12:47 user nova-compute[72409]:   <serial>3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b</serial>
Aug 09 23:12:47 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:12:47 user nova-compute[72409]: </disk>
Aug 09 23:12:47 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622768.4096348, e870efcb-fcb2-4dda-b92a-538fd06f16a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:12:48 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Successfully detached device vdb from instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 from the live domain config.
Aug 09 23:12:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DnojcrbI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:12:48 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f461c2-a559-4964-9a4b-b9e1026f2636]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ed570c-fc51-40e1-93c0-18d4c826fd1a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:12:48 user nova-compute[72409]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b (non-flash)
Aug 09 23:12:48 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:12:48 user nova-compute[72409]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b (non-flash)
Aug 09 23:12:48 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e943829e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b'): ({'sdd'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Removing single pathed devices sdd {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b604c9-0658-488d-9a7c-270b431a0566]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e513bc83-4f13-4047-9721-0dec95eb14f2]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Flushing IO for device /dev/sdd {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee350436-dae0-4f7b-bfb4-ea8305e059d8]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[86592318-5f8c-4a57-8afc-45fe0e55ca2a]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be10c79-4402-4079-a612-19ec1fff5bb9]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c2e5a0-1a9c-495b-b6aa-605967fa02db]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b, portal: 172.16.0.220,3260]
Aug 09 23:12:48 user nova-compute[72409]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b, portal: 172.16.0.220,3260] successful.
Aug 09 23:12:48 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ed8c9d2-f00a-40e9-a8e8-951ef74e7c6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6339620a-3e83-4ede-8e56-12dbbe17657c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] <== disconnect_volume: return (256ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:12:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:49 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'flavor' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:12:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a88e4fd8-ec25-4224-937d-d7ae9f3b3c6a tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.513s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:12:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:12:58 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622763.6540232, 3f9eb677-11aa-4398-87dd-560c055d1c2c => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:12:58 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] VM Stopped (Lifecycle Event)
Aug 09 23:12:58 user nova-compute[72409]: DEBUG nova.compute.manager [None req-12529462-ce04-447e-9bb4-acab77eae82a None None] [instance: 3f9eb677-11aa-4398-87dd-560c055d1c2c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:12:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:02 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:13:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:13:06 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:13:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:06 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:08 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:13:08 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:13:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8129MB free_disk=25.324920654296875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a97303da-cb91-40b9-a7bc-c674365a482e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:13:08 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:13:09 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:13:09 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:13:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:13:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:13:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:13:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-e870efcb-fcb2-4dda-b92a-538fd06f16a7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:13:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-e870efcb-fcb2-4dda-b92a-538fd06f16a7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:13:12 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:13:12 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Updating instance_info_cache with network_info: [{"id": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "address": "fa:16:3e:1e:a5:0b", "network": {"id": "a77ce7e5-f19c-4182-b6b9-52bdbd861868", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-539340574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28055127bfa44a1e8a8c2b79fae46838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc463ae05-66", "ovs_interfaceid": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:13:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-e870efcb-fcb2-4dda-b92a-538fd06f16a7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:13:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:13:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:13:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:13:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:13:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:13:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:13 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:13:13 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:13:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:13:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:13:35 user nova-compute[72409]: INFO nova.compute.claims [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Claim successful on node user
Aug 09 23:13:35 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:13:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:13:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG nova.policy [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '404739e50bd042d29d060fb39c1f8c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5148973bc704627aeccf788e9ac4412', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:13:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Creating image(s)
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "/opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "/opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "/opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.156s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.130s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk 1073741824" returned: 0 in 0.049s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Cannot resize image /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'migration_context' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Ensure instance console log exists: /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:36 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Successfully created port: 051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Successfully updated port: 051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquired lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-9c10f38c-cb15-412f-82c8-31ee62f8e447 req-828be1fe-f286-4cf8-9d0b-55368da3cf27 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-changed-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-9c10f38c-cb15-412f-82c8-31ee62f8e447 req-828be1fe-f286-4cf8-9d0b-55368da3cf27 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Refreshing instance network info cache due to event network-changed-051b3c51-4821-4807-b65f-f5fe5894509c. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9c10f38c-cb15-412f-82c8-31ee62f8e447 req-828be1fe-f286-4cf8-9d0b-55368da3cf27 service nova] Acquiring lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updating instance_info_cache with network_info: [{"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Releasing lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance network_info: |[{"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9c10f38c-cb15-412f-82c8-31ee62f8e447 req-828be1fe-f286-4cf8-9d0b-55368da3cf27 service nova] Acquired lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.network.neutron [req-9c10f38c-cb15-412f-82c8-31ee62f8e447 req-828be1fe-f286-4cf8-9d0b-55368da3cf27 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Refreshing network info cache for port 051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Start _get_guest_xml network_info=[{"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:13:37 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:13:37 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-158408380',display_name='tempest-AttachVolumeTestJSON-server-158408380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-158408380',id=43,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7cyVxAqMw/gmzCUNmkaDKLkx5O4eZ4SJ14bCtziFqZelGzHQrhavYLL+rKID1RcDRMeRuc/KiuUItVmoh138Xg+EqTD2HksOySvGeMflViOS+DxVsxR1mjmffB7SuBiA==',key_name='tempest-keypair-867359187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5148973bc704627aeccf788e9ac4412',ramdisk_id='',reservation_id='r-hclxvq1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1885013657',owner_user_name='tempest-AttachVolumeTestJSON-1885013657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:13:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='404739e50bd042d29d060fb39c1f8c4a',uuid=c43b9b78-3237-4cb0-be8a-0b3ec6e53aba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converting VIF {"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'pci_devices' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:13:37 user nova-compute[72409]:   <uuid>c43b9b78-3237-4cb0-be8a-0b3ec6e53aba</uuid>
Aug 09 23:13:37 user nova-compute[72409]:   <name>instance-0000002b</name>
Aug 09 23:13:37 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:13:37 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:13:37 user nova-compute[72409]:   <metadata>
Aug 09 23:13:37 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:13:37 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:13:37 user nova-compute[72409]:       <nova:name>tempest-AttachVolumeTestJSON-server-158408380</nova:name>
Aug 09 23:13:37 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:13:37</nova:creationTime>
Aug 09 23:13:37 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:13:37 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:13:37 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:13:37 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:13:37 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:13:37 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:13:37 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:13:37 user nova-compute[72409]:       <nova:owner>
Aug 09 23:13:37 user nova-compute[72409]:         <nova:user uuid="404739e50bd042d29d060fb39c1f8c4a">tempest-AttachVolumeTestJSON-1885013657-project-member</nova:user>
Aug 09 23:13:37 user nova-compute[72409]:         <nova:project uuid="b5148973bc704627aeccf788e9ac4412">tempest-AttachVolumeTestJSON-1885013657</nova:project>
Aug 09 23:13:37 user nova-compute[72409]:       </nova:owner>
Aug 09 23:13:37 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:13:37 user nova-compute[72409]:       <nova:ports>
Aug 09 23:13:37 user nova-compute[72409]:         <nova:port uuid="051b3c51-4821-4807-b65f-f5fe5894509c">
Aug 09 23:13:37 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 23:13:37 user nova-compute[72409]:         </nova:port>
Aug 09 23:13:37 user nova-compute[72409]:       </nova:ports>
Aug 09 23:13:37 user nova-compute[72409]:     </nova:instance>
Aug 09 23:13:37 user nova-compute[72409]:   </metadata>
Aug 09 23:13:37 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:13:37 user nova-compute[72409]:     <system>
Aug 09 23:13:37 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:13:37 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:13:37 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:13:37 user nova-compute[72409]:       <entry name="serial">c43b9b78-3237-4cb0-be8a-0b3ec6e53aba</entry>
Aug 09 23:13:37 user nova-compute[72409]:       <entry name="uuid">c43b9b78-3237-4cb0-be8a-0b3ec6e53aba</entry>
Aug 09 23:13:37 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:13:37 user nova-compute[72409]:     </system>
Aug 09 23:13:37 user nova-compute[72409]:   </sysinfo>
Aug 09 23:13:37 user nova-compute[72409]:   <os>
Aug 09 23:13:37 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:13:37 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:13:37 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:13:37 user nova-compute[72409]:   </os>
Aug 09 23:13:37 user nova-compute[72409]:   <features>
Aug 09 23:13:37 user nova-compute[72409]:     <acpi/>
Aug 09 23:13:37 user nova-compute[72409]:     <apic/>
Aug 09 23:13:37 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:13:37 user nova-compute[72409]:   </features>
Aug 09 23:13:37 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:13:37 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:13:37 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:13:37 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:13:37 user nova-compute[72409]:   </clock>
Aug 09 23:13:37 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:13:37 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:13:37 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:13:37 user nova-compute[72409]:   </cpu>
Aug 09 23:13:37 user nova-compute[72409]:   <devices>
Aug 09 23:13:37 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:13:37 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:13:37 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk"/>
Aug 09 23:13:37 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:13:37 user nova-compute[72409]:     </disk>
Aug 09 23:13:37 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:13:37 user nova-compute[72409]:       <mac address="fa:16:3e:19:e9:13"/>
Aug 09 23:13:37 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:13:37 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:13:37 user nova-compute[72409]:       <target dev="tap051b3c51-48"/>
Aug 09 23:13:37 user nova-compute[72409]:     </interface>
Aug 09 23:13:37 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:13:37 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/console.log" append="off"/>
Aug 09 23:13:37 user nova-compute[72409]:     </serial>
Aug 09 23:13:37 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:13:37 user nova-compute[72409]:     <video>
Aug 09 23:13:37 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:13:37 user nova-compute[72409]:     </video>
Aug 09 23:13:37 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:13:37 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:13:37 user nova-compute[72409]:     </rng>
Aug 09 23:13:37 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:13:37 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:13:37 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:13:37 user nova-compute[72409]:     </memballoon>
Aug 09 23:13:37 user nova-compute[72409]:   </devices>
Aug 09 23:13:37 user nova-compute[72409]: </domain>
Aug 09 23:13:37 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-158408380',display_name='tempest-AttachVolumeTestJSON-server-158408380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-158408380',id=43,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7cyVxAqMw/gmzCUNmkaDKLkx5O4eZ4SJ14bCtziFqZelGzHQrhavYLL+rKID1RcDRMeRuc/KiuUItVmoh138Xg+EqTD2HksOySvGeMflViOS+DxVsxR1mjmffB7SuBiA==',key_name='tempest-keypair-867359187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5148973bc704627aeccf788e9ac4412',ramdisk_id='',reservation_id='r-hclxvq1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1885013657',owner_user_name='tempest-AttachVolumeTestJSON-1885013657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:13:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='404739e50bd042d29d060fb39c1f8c4a',uuid=c43b9b78-3237-4cb0-be8a-0b3ec6e53aba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converting VIF {"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG os_vif [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap051b3c51-48, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap051b3c51-48, col_values=(('external_ids', {'iface-id': '051b3c51-4821-4807-b65f-f5fe5894509c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:e9:13', 'vm-uuid': 'c43b9b78-3237-4cb0-be8a-0b3ec6e53aba'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:13:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:37 user nova-compute[72409]: INFO os_vif [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48')
Aug 09 23:13:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:13:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No VIF found with MAC fa:16:3e:19:e9:13, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:13:38 user nova-compute[72409]: DEBUG nova.network.neutron [req-9c10f38c-cb15-412f-82c8-31ee62f8e447 req-828be1fe-f286-4cf8-9d0b-55368da3cf27 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updated VIF entry in instance network info cache for port 051b3c51-4821-4807-b65f-f5fe5894509c. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:13:38 user nova-compute[72409]: DEBUG nova.network.neutron [req-9c10f38c-cb15-412f-82c8-31ee62f8e447 req-828be1fe-f286-4cf8-9d0b-55368da3cf27 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updating instance_info_cache with network_info: [{"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:13:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9c10f38c-cb15-412f-82c8-31ee62f8e447 req-828be1fe-f286-4cf8-9d0b-55368da3cf27 service nova] Releasing lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:13:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-37a0defb-100b-405c-9214-d05664febba5 req-a2066cf9-a4db-400b-8718-e857aff15911 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:13:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-37a0defb-100b-405c-9214-d05664febba5 req-a2066cf9-a4db-400b-8718-e857aff15911 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-37a0defb-100b-405c-9214-d05664febba5 req-a2066cf9-a4db-400b-8718-e857aff15911 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-37a0defb-100b-405c-9214-d05664febba5 req-a2066cf9-a4db-400b-8718-e857aff15911 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-37a0defb-100b-405c-9214-d05664febba5 req-a2066cf9-a4db-400b-8718-e857aff15911 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:13:39 user nova-compute[72409]: WARNING nova.compute.manager [req-37a0defb-100b-405c-9214-d05664febba5 req-a2066cf9-a4db-400b-8718-e857aff15911 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state building and task_state spawning.
Aug 09 23:13:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622821.4998002, c43b9b78-3237-4cb0-be8a-0b3ec6e53aba => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:13:41 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] VM Resumed (Lifecycle Event)
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:13:41 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance spawned successfully.
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:13:41 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622821.5019968, c43b9b78-3237-4cb0-be8a-0b3ec6e53aba => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:13:41 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] VM Started (Lifecycle Event)
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:13:41 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-a0b536ab-d94a-4e04-91df-f2d0af86d203 req-390274ed-c224-4c99-80d1-813a686e5ee5 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a0b536ab-d94a-4e04-91df-f2d0af86d203 req-390274ed-c224-4c99-80d1-813a686e5ee5 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a0b536ab-d94a-4e04-91df-f2d0af86d203 req-390274ed-c224-4c99-80d1-813a686e5ee5 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a0b536ab-d94a-4e04-91df-f2d0af86d203 req-390274ed-c224-4c99-80d1-813a686e5ee5 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-a0b536ab-d94a-4e04-91df-f2d0af86d203 req-390274ed-c224-4c99-80d1-813a686e5ee5 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:13:41 user nova-compute[72409]: WARNING nova.compute.manager [req-a0b536ab-d94a-4e04-91df-f2d0af86d203 req-390274ed-c224-4c99-80d1-813a686e5ee5 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state building and task_state spawning.
Aug 09 23:13:41 user nova-compute[72409]: INFO nova.compute.manager [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Took 5.85 seconds to spawn the instance on the hypervisor.
Aug 09 23:13:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:13:41 user nova-compute[72409]: INFO nova.compute.manager [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Took 6.48 seconds to build instance.
Aug 09 23:13:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c4ad9eba-8509-4524-807e-30e078ab9389 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.574s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-3a325401-7881-45c2-be4e-189f232016b8 req-c2119045-8d16-4383-ab4c-59a24b48e3f0 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Received event network-changed-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG nova.compute.manager [req-3a325401-7881-45c2-be4e-189f232016b8 req-c2119045-8d16-4383-ab4c-59a24b48e3f0 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Refreshing instance network info cache due to event network-changed-88c8db8a-4d24-48f5-b62e-03b2eb95ba33. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3a325401-7881-45c2-be4e-189f232016b8 req-c2119045-8d16-4383-ab4c-59a24b48e3f0 service nova] Acquiring lock "refresh_cache-a97303da-cb91-40b9-a7bc-c674365a482e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3a325401-7881-45c2-be4e-189f232016b8 req-c2119045-8d16-4383-ab4c-59a24b48e3f0 service nova] Acquired lock "refresh_cache-a97303da-cb91-40b9-a7bc-c674365a482e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG nova.network.neutron [req-3a325401-7881-45c2-be4e-189f232016b8 req-c2119045-8d16-4383-ab4c-59a24b48e3f0 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Refreshing network info cache for port 88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "a97303da-cb91-40b9-a7bc-c674365a482e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "a97303da-cb91-40b9-a7bc-c674365a482e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:50 user nova-compute[72409]: INFO nova.compute.manager [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Terminating instance
Aug 09 23:13:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG nova.network.neutron [req-3a325401-7881-45c2-be4e-189f232016b8 req-c2119045-8d16-4383-ab4c-59a24b48e3f0 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Updated VIF entry in instance network info cache for port 88c8db8a-4d24-48f5-b62e-03b2eb95ba33. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG nova.network.neutron [req-3a325401-7881-45c2-be4e-189f232016b8 req-c2119045-8d16-4383-ab4c-59a24b48e3f0 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Updating instance_info_cache with network_info: [{"id": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "address": "fa:16:3e:8c:ea:41", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8db8a-4d", "ovs_interfaceid": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:13:50 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3a325401-7881-45c2-be4e-189f232016b8 req-c2119045-8d16-4383-ab4c-59a24b48e3f0 service nova] Releasing lock "refresh_cache-a97303da-cb91-40b9-a7bc-c674365a482e" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:13:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Instance destroyed successfully.
Aug 09 23:13:51 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lazy-loading 'resources' on Instance uuid a97303da-cb91-40b9-a7bc-c674365a482e {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-74785377',display_name='tempest-TestVolumeBootPattern-server-74785377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-74785377',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1aHN+hYxllL5tuB8HvAlIacEjfYF+w1msAbdktrPPHCcF11JPXwNiBeUP+wL/G+SHuINuvHbsNfaNGa+fgVIlRHvAF1ETChrpZfHrOyvh53hIFQ9t/gmToggpOGTMoMw==',key_name='tempest-TestVolumeBootPattern-982211312',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6d29522bd16460eb1edc9fb7918111f',ramdisk_id='',reservation_id='r-0oulejdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-431608932',owner_user_name='tempest-TestVolumeBootPattern-431608932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:08:58Z,user_data=None,user_id='bcd5e2f13e0a448e836dd8684b889a70',uuid=a97303da-cb91-40b9-a7bc-c674365a482e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "address": "fa:16:3e:8c:ea:41", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8db8a-4d", "ovs_interfaceid": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converting VIF {"id": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "address": "fa:16:3e:8c:ea:41", "network": {"id": "43fa0ab9-f03d-4a63-8760-a43aedfb9ff4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1190251497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6d29522bd16460eb1edc9fb7918111f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88c8db8a-4d", "ovs_interfaceid": "88c8db8a-4d24-48f5-b62e-03b2eb95ba33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=88c8db8a-4d24-48f5-b62e-03b2eb95ba33,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8db8a-4d') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_vif [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=88c8db8a-4d24-48f5-b62e-03b2eb95ba33,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8db8a-4d') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88c8db8a-4d, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:13:51 user nova-compute[72409]: INFO os_vif [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ea:41,bridge_name='br-int',has_traffic_filtering=True,id=88c8db8a-4d24-48f5-b62e-03b2eb95ba33,network=Network(43fa0ab9-f03d-4a63-8760-a43aedfb9ff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88c8db8a-4d')
Aug 09 23:13:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQBwOVRZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:13:51 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[85068fc4-481f-44b4-b787-be7b8b8b44cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed26e4e-28f5-45e4-a039-36add109a177]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:13:51 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a (non-flash)
Aug 09 23:13:51 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e845cbac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edd48c2-a197-4d10-aae9-2e5881fbc574]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdefc2b-d4e2-4416-834f-e4d0f5b7c734]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ab39e0-ae3a-420f-9164-5ff79db261f7]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cc688b-8fc6-40c3-8d49-98643ce8ae1c]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOec60bbb4-6fdd4a3eaa6b3953', '/dev/disk/by-id/scsi-23666646434613365', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ec60bbb4') {{(pid=83250) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfba1e11-cc25-4869-9195-0107701d2ef6]: (4, None) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7765bf-3eb1-4ea8-b721-df00a7555769]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d06868-5584-4cd6-8b8b-51d7b30523d7]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260]
Aug 09 23:13:51 user nova-compute[72409]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a, portal: 172.16.0.220,3260] successful.
Aug 09 23:13:51 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ad73b76-b30a-4219-ac4c-7c96747e462a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[947694df-6887-4451-86d9-629ba50b5e24]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] <== disconnect_volume: return (289ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:13:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Deleting instance files /opt/stack/data/nova/instances/a97303da-cb91-40b9-a7bc-c674365a482e_del
Aug 09 23:13:51 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Deletion of /opt/stack/data/nova/instances/a97303da-cb91-40b9-a7bc-c674365a482e_del complete
Aug 09 23:13:51 user nova-compute[72409]: INFO nova.compute.manager [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 09 23:13:51 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:13:51 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:13:52 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Took 0.56 seconds to deallocate network for instance.
Aug 09 23:13:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-188f46f1-6684-4f4b-b90c-49bf9aa99f84 req-7e6d4619-b872-48b3-88ca-f5e22137a660 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Received event network-vif-deleted-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:13:52 user nova-compute[72409]: INFO nova.compute.manager [req-188f46f1-6684-4f4b-b90c-49bf9aa99f84 req-7e6d4619-b872-48b3-88ca-f5e22137a660 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Neutron deleted interface 88c8db8a-4d24-48f5-b62e-03b2eb95ba33; detaching it from the instance and deleting it from the info cache
Aug 09 23:13:52 user nova-compute[72409]: DEBUG nova.network.neutron [req-188f46f1-6684-4f4b-b90c-49bf9aa99f84 req-7e6d4619-b872-48b3-88ca-f5e22137a660 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-188f46f1-6684-4f4b-b90c-49bf9aa99f84 req-7e6d4619-b872-48b3-88ca-f5e22137a660 service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Detach interface failed, port_id=88c8db8a-4d24-48f5-b62e-03b2eb95ba33, reason: Instance a97303da-cb91-40b9-a7bc-c674365a482e could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-1b0171ae-6e3c-4a06-86e5-5c5425462a26 req-e5c2de4f-2237-4821-8d7c-c7287e7c009b service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Received event network-vif-unplugged-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1b0171ae-6e3c-4a06-86e5-5c5425462a26 req-e5c2de4f-2237-4821-8d7c-c7287e7c009b service nova] Acquiring lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1b0171ae-6e3c-4a06-86e5-5c5425462a26 req-e5c2de4f-2237-4821-8d7c-c7287e7c009b service nova] Lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1b0171ae-6e3c-4a06-86e5-5c5425462a26 req-e5c2de4f-2237-4821-8d7c-c7287e7c009b service nova] Lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-1b0171ae-6e3c-4a06-86e5-5c5425462a26 req-e5c2de4f-2237-4821-8d7c-c7287e7c009b service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] No waiting events found dispatching network-vif-unplugged-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-1b0171ae-6e3c-4a06-86e5-5c5425462a26 req-e5c2de4f-2237-4821-8d7c-c7287e7c009b service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Received event network-vif-unplugged-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-1b0171ae-6e3c-4a06-86e5-5c5425462a26 req-e5c2de4f-2237-4821-8d7c-c7287e7c009b service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Received event network-vif-plugged-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1b0171ae-6e3c-4a06-86e5-5c5425462a26 req-e5c2de4f-2237-4821-8d7c-c7287e7c009b service nova] Acquiring lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1b0171ae-6e3c-4a06-86e5-5c5425462a26 req-e5c2de4f-2237-4821-8d7c-c7287e7c009b service nova] Lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1b0171ae-6e3c-4a06-86e5-5c5425462a26 req-e5c2de4f-2237-4821-8d7c-c7287e7c009b service nova] Lock "a97303da-cb91-40b9-a7bc-c674365a482e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:52 user nova-compute[72409]: DEBUG nova.compute.manager [req-1b0171ae-6e3c-4a06-86e5-5c5425462a26 req-e5c2de4f-2237-4821-8d7c-c7287e7c009b service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] No waiting events found dispatching network-vif-plugged-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:13:52 user nova-compute[72409]: WARNING nova.compute.manager [req-1b0171ae-6e3c-4a06-86e5-5c5425462a26 req-e5c2de4f-2237-4821-8d7c-c7287e7c009b service nova] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Received unexpected event network-vif-plugged-88c8db8a-4d24-48f5-b62e-03b2eb95ba33 for instance with vm_state active and task_state deleting.
Aug 09 23:13:52 user nova-compute[72409]: INFO nova.compute.manager [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Took 0.85 seconds to detach 1 volumes for instance.
Aug 09 23:13:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:53 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:13:53 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:13:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:53 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Deleted allocations for instance a97303da-cb91-40b9-a7bc-c674365a482e
Aug 09 23:13:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b1c676c2-4ee4-40c7-a94e-4d4c31e4017c tempest-TestVolumeBootPattern-431608932 tempest-TestVolumeBootPattern-431608932-project-member] Lock "a97303da-cb91-40b9-a7bc-c674365a482e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.341s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG nova.compute.manager [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:13:55 user nova-compute[72409]: INFO nova.compute.claims [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Claim successful on node user
Aug 09 23:13:55 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG nova.compute.manager [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG nova.compute.manager [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:13:55 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:13:55 user nova-compute[72409]: DEBUG nova.compute.manager [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG nova.policy [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de2d9f7ad5bb4a93ab61ab100eb1778d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41897ed2b644775a5dcb22d1ecd60a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG nova.compute.manager [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:13:55 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Creating image(s)
Aug 09 23:13:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "/opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "/opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "/opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.149s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk 1073741824" returned: 0 in 0.058s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Cannot resize image /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG nova.objects.instance [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'migration_context' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Ensure instance console log exists: /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:56 user nova-compute[72409]: DEBUG nova.network.neutron [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Successfully created port: d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.network.neutron [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Successfully updated port: d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquired lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.network.neutron [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-1016a16e-4f35-44e7-b656-6010479920e0 req-7bc749a2-d0cf-4312-84ce-cad4245e3e1f service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-changed-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-1016a16e-4f35-44e7-b656-6010479920e0 req-7bc749a2-d0cf-4312-84ce-cad4245e3e1f service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Refreshing instance network info cache due to event network-changed-d115dd28-4650-4494-8fb0-d387a77b1600. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1016a16e-4f35-44e7-b656-6010479920e0 req-7bc749a2-d0cf-4312-84ce-cad4245e3e1f service nova] Acquiring lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.network.neutron [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.network.neutron [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updating instance_info_cache with network_info: [{"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Releasing lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Instance network_info: |[{"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1016a16e-4f35-44e7-b656-6010479920e0 req-7bc749a2-d0cf-4312-84ce-cad4245e3e1f service nova] Acquired lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.network.neutron [req-1016a16e-4f35-44e7-b656-6010479920e0 req-7bc749a2-d0cf-4312-84ce-cad4245e3e1f service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Refreshing network info cache for port d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Start _get_guest_xml network_info=[{"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:13:57 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:13:57 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:13:57 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-899627340',display_name='tempest-ServerRescueNegativeTestJSON-server-899627340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-899627340',id=44,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+Br0sqy7btjDPu+x0UxuVaCzJxyOFJSXaS/DTk5G+W8EKbv1EgqwSxTUZklmQSJqsdwz/nAqjT9MvfhoEmk2kJC5gxj7MsfxATlRr4Evjp0O4tu0pw/TG7W96oZ+VJRg==',key_name='tempest-keypair-960642969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d41897ed2b644775a5dcb22d1ecd60a0',ramdisk_id='',reservation_id='r-v0xxbfd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-850997564',owner_user_name='tempest-ServerRescueNegativeTestJSON-850997564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de2d9f7ad5bb4a93ab61ab100eb1778d',uuid=76e542ee-fc49-430c-b2c3-2cd2913075a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converting VIF {"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=d115dd28-4650-4494-8fb0-d387a77b1600,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115dd28-46') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG nova.objects.instance [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'pci_devices' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:13:58 user nova-compute[72409]:   <uuid>76e542ee-fc49-430c-b2c3-2cd2913075a0</uuid>
Aug 09 23:13:58 user nova-compute[72409]:   <name>instance-0000002c</name>
Aug 09 23:13:58 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:13:58 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:13:58 user nova-compute[72409]:   <metadata>
Aug 09 23:13:58 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:13:58 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:13:58 user nova-compute[72409]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-899627340</nova:name>
Aug 09 23:13:58 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:13:57</nova:creationTime>
Aug 09 23:13:58 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:13:58 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:13:58 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:13:58 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:13:58 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:13:58 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:13:58 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:13:58 user nova-compute[72409]:       <nova:owner>
Aug 09 23:13:58 user nova-compute[72409]:         <nova:user uuid="de2d9f7ad5bb4a93ab61ab100eb1778d">tempest-ServerRescueNegativeTestJSON-850997564-project-member</nova:user>
Aug 09 23:13:58 user nova-compute[72409]:         <nova:project uuid="d41897ed2b644775a5dcb22d1ecd60a0">tempest-ServerRescueNegativeTestJSON-850997564</nova:project>
Aug 09 23:13:58 user nova-compute[72409]:       </nova:owner>
Aug 09 23:13:58 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:13:58 user nova-compute[72409]:       <nova:ports>
Aug 09 23:13:58 user nova-compute[72409]:         <nova:port uuid="d115dd28-4650-4494-8fb0-d387a77b1600">
Aug 09 23:13:58 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 23:13:58 user nova-compute[72409]:         </nova:port>
Aug 09 23:13:58 user nova-compute[72409]:       </nova:ports>
Aug 09 23:13:58 user nova-compute[72409]:     </nova:instance>
Aug 09 23:13:58 user nova-compute[72409]:   </metadata>
Aug 09 23:13:58 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:13:58 user nova-compute[72409]:     <system>
Aug 09 23:13:58 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:13:58 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:13:58 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:13:58 user nova-compute[72409]:       <entry name="serial">76e542ee-fc49-430c-b2c3-2cd2913075a0</entry>
Aug 09 23:13:58 user nova-compute[72409]:       <entry name="uuid">76e542ee-fc49-430c-b2c3-2cd2913075a0</entry>
Aug 09 23:13:58 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:13:58 user nova-compute[72409]:     </system>
Aug 09 23:13:58 user nova-compute[72409]:   </sysinfo>
Aug 09 23:13:58 user nova-compute[72409]:   <os>
Aug 09 23:13:58 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:13:58 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:13:58 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:13:58 user nova-compute[72409]:   </os>
Aug 09 23:13:58 user nova-compute[72409]:   <features>
Aug 09 23:13:58 user nova-compute[72409]:     <acpi/>
Aug 09 23:13:58 user nova-compute[72409]:     <apic/>
Aug 09 23:13:58 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:13:58 user nova-compute[72409]:   </features>
Aug 09 23:13:58 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:13:58 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:13:58 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:13:58 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:13:58 user nova-compute[72409]:   </clock>
Aug 09 23:13:58 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:13:58 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:13:58 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:13:58 user nova-compute[72409]:   </cpu>
Aug 09 23:13:58 user nova-compute[72409]:   <devices>
Aug 09 23:13:58 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:13:58 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:13:58 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk"/>
Aug 09 23:13:58 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:13:58 user nova-compute[72409]:     </disk>
Aug 09 23:13:58 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:13:58 user nova-compute[72409]:       <mac address="fa:16:3e:68:90:c5"/>
Aug 09 23:13:58 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:13:58 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:13:58 user nova-compute[72409]:       <target dev="tapd115dd28-46"/>
Aug 09 23:13:58 user nova-compute[72409]:     </interface>
Aug 09 23:13:58 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:13:58 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/console.log" append="off"/>
Aug 09 23:13:58 user nova-compute[72409]:     </serial>
Aug 09 23:13:58 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:13:58 user nova-compute[72409]:     <video>
Aug 09 23:13:58 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:13:58 user nova-compute[72409]:     </video>
Aug 09 23:13:58 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:13:58 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:13:58 user nova-compute[72409]:     </rng>
Aug 09 23:13:58 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:13:58 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:13:58 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:13:58 user nova-compute[72409]:     </memballoon>
Aug 09 23:13:58 user nova-compute[72409]:   </devices>
Aug 09 23:13:58 user nova-compute[72409]: </domain>
Aug 09 23:13:58 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-899627340',display_name='tempest-ServerRescueNegativeTestJSON-server-899627340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-899627340',id=44,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+Br0sqy7btjDPu+x0UxuVaCzJxyOFJSXaS/DTk5G+W8EKbv1EgqwSxTUZklmQSJqsdwz/nAqjT9MvfhoEmk2kJC5gxj7MsfxATlRr4Evjp0O4tu0pw/TG7W96oZ+VJRg==',key_name='tempest-keypair-960642969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d41897ed2b644775a5dcb22d1ecd60a0',ramdisk_id='',reservation_id='r-v0xxbfd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-850997564',owner_user_name='tempest-ServerRescueNegativeTestJSON-850997564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de2d9f7ad5bb4a93ab61ab100eb1778d',uuid=76e542ee-fc49-430c-b2c3-2cd2913075a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converting VIF {"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=d115dd28-4650-4494-8fb0-d387a77b1600,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115dd28-46') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG os_vif [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=d115dd28-4650-4494-8fb0-d387a77b1600,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115dd28-46') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd115dd28-46, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd115dd28-46, col_values=(('external_ids', {'iface-id': 'd115dd28-4650-4494-8fb0-d387a77b1600', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:90:c5', 'vm-uuid': '76e542ee-fc49-430c-b2c3-2cd2913075a0'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:58 user nova-compute[72409]: INFO os_vif [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=d115dd28-4650-4494-8fb0-d387a77b1600,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115dd28-46')
Aug 09 23:13:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No VIF found with MAC fa:16:3e:68:90:c5, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG nova.network.neutron [req-1016a16e-4f35-44e7-b656-6010479920e0 req-7bc749a2-d0cf-4312-84ce-cad4245e3e1f service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updated VIF entry in instance network info cache for port d115dd28-4650-4494-8fb0-d387a77b1600. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG nova.network.neutron [req-1016a16e-4f35-44e7-b656-6010479920e0 req-7bc749a2-d0cf-4312-84ce-cad4245e3e1f service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updating instance_info_cache with network_info: [{"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:13:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1016a16e-4f35-44e7-b656-6010479920e0 req-7bc749a2-d0cf-4312-84ce-cad4245e3e1f service nova] Releasing lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:13:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:13:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-fb691b08-0500-48ca-aee3-72e0c14eb467 req-88801133-450f-4037-bc5b-d3cd76d01e3e service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:13:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fb691b08-0500-48ca-aee3-72e0c14eb467 req-88801133-450f-4037-bc5b-d3cd76d01e3e service nova] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:13:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fb691b08-0500-48ca-aee3-72e0c14eb467 req-88801133-450f-4037-bc5b-d3cd76d01e3e service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:13:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fb691b08-0500-48ca-aee3-72e0c14eb467 req-88801133-450f-4037-bc5b-d3cd76d01e3e service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:13:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-fb691b08-0500-48ca-aee3-72e0c14eb467 req-88801133-450f-4037-bc5b-d3cd76d01e3e service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] No waiting events found dispatching network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:13:59 user nova-compute[72409]: WARNING nova.compute.manager [req-fb691b08-0500-48ca-aee3-72e0c14eb467 req-88801133-450f-4037-bc5b-d3cd76d01e3e service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received unexpected event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 for instance with vm_state building and task_state spawning.
Aug 09 23:13:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622841.5719185, 76e542ee-fc49-430c-b2c3-2cd2913075a0 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:14:01 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] VM Resumed (Lifecycle Event)
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:14:01 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Instance spawned successfully.
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:14:01 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622841.5734725, 76e542ee-fc49-430c-b2c3-2cd2913075a0 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:14:01 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] VM Started (Lifecycle Event)
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:14:01 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:14:01 user nova-compute[72409]: INFO nova.compute.manager [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.compute.manager [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-169aa579-2d81-4e31-be26-c17855c55328 req-5b0bfc34-0220-441f-9629-a93959793c5e service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-169aa579-2d81-4e31-be26-c17855c55328 req-5b0bfc34-0220-441f-9629-a93959793c5e service nova] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-169aa579-2d81-4e31-be26-c17855c55328 req-5b0bfc34-0220-441f-9629-a93959793c5e service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-169aa579-2d81-4e31-be26-c17855c55328 req-5b0bfc34-0220-441f-9629-a93959793c5e service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:14:01 user nova-compute[72409]: DEBUG nova.compute.manager [req-169aa579-2d81-4e31-be26-c17855c55328 req-5b0bfc34-0220-441f-9629-a93959793c5e service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] No waiting events found dispatching network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:14:01 user nova-compute[72409]: WARNING nova.compute.manager [req-169aa579-2d81-4e31-be26-c17855c55328 req-5b0bfc34-0220-441f-9629-a93959793c5e service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received unexpected event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 for instance with vm_state building and task_state spawning.
Aug 09 23:14:01 user nova-compute[72409]: INFO nova.compute.manager [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Took 6.48 seconds to build instance.
Aug 09 23:14:01 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-191a8800-6592-4692-b4b0-7deccc7a2299 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.632s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:14:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:14:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:14:06 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622831.0683715, a97303da-cb91-40b9-a7bc-c674365a482e => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:14:06 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] VM Stopped (Lifecycle Event)
Aug 09 23:14:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-91e307ab-66fa-468e-965b-481986d809ad None None] [instance: a97303da-cb91-40b9-a7bc-c674365a482e] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:14:06 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:14:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:07 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:14:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:14:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:14:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:14:07 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:10 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:14:10 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:14:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=7955MB free_disk=25.284896850585938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance e870efcb-fcb2-4dda-b92a-538fd06f16a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 76e542ee-fc49-430c-b2c3-2cd2913075a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:14:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:14:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:14 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:14:14 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:14:14 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 23:14:14 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:14:14 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:14:14 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:14:14 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:14:14 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:14:14 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:14:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:20 user nova-compute[72409]: DEBUG nova.compute.manager [req-b2b792f0-dfb4-4648-a0ca-4cb9f00e597c req-37288d00-2958-46d1-abcc-f888948b75a3 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received event network-changed-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:14:20 user nova-compute[72409]: DEBUG nova.compute.manager [req-b2b792f0-dfb4-4648-a0ca-4cb9f00e597c req-37288d00-2958-46d1-abcc-f888948b75a3 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Refreshing instance network info cache due to event network-changed-eb627aae-6309-48cb-8145-a9e530cc8d39. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:14:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b2b792f0-dfb4-4648-a0ca-4cb9f00e597c req-37288d00-2958-46d1-abcc-f888948b75a3 service nova] Acquiring lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:14:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b2b792f0-dfb4-4648-a0ca-4cb9f00e597c req-37288d00-2958-46d1-abcc-f888948b75a3 service nova] Acquired lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:14:20 user nova-compute[72409]: DEBUG nova.network.neutron [req-b2b792f0-dfb4-4648-a0ca-4cb9f00e597c req-37288d00-2958-46d1-abcc-f888948b75a3 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Refreshing network info cache for port eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG nova.network.neutron [req-b2b792f0-dfb4-4648-a0ca-4cb9f00e597c req-37288d00-2958-46d1-abcc-f888948b75a3 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Updated VIF entry in instance network info cache for port eb627aae-6309-48cb-8145-a9e530cc8d39. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG nova.network.neutron [req-b2b792f0-dfb4-4648-a0ca-4cb9f00e597c req-37288d00-2958-46d1-abcc-f888948b75a3 service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Updating instance_info_cache with network_info: [{"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b2b792f0-dfb4-4648-a0ca-4cb9f00e597c req-37288d00-2958-46d1-abcc-f888948b75a3 service nova] Releasing lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:14:21 user nova-compute[72409]: INFO nova.compute.manager [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Terminating instance
Aug 09 23:14:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG nova.objects.instance [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lazy-loading 'flavor' on Instance uuid 5a24033f-5bf1-4747-a8f4-3edc32600a9a {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:14:21 user nova-compute[72409]: INFO nova.compute.manager [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Attaching volume 4b2cbabd-53d2-483d-b44d-d09464cb2ec9 to /dev/vdb
Aug 09 23:14:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-6a8f99f5-f35f-42ff-b3ec-232c31be9e30 req-718d98b8-ce48-4e84-848f-1ad5eac1f641 service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Received event network-vif-unplugged-c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a8f99f5-f35f-42ff-b3ec-232c31be9e30 req-718d98b8-ce48-4e84-848f-1ad5eac1f641 service nova] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a8f99f5-f35f-42ff-b3ec-232c31be9e30 req-718d98b8-ce48-4e84-848f-1ad5eac1f641 service nova] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a8f99f5-f35f-42ff-b3ec-232c31be9e30 req-718d98b8-ce48-4e84-848f-1ad5eac1f641 service nova] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-6a8f99f5-f35f-42ff-b3ec-232c31be9e30 req-718d98b8-ce48-4e84-848f-1ad5eac1f641 service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] No waiting events found dispatching network-vif-unplugged-c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-6a8f99f5-f35f-42ff-b3ec-232c31be9e30 req-718d98b8-ce48-4e84-848f-1ad5eac1f641 service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Received event network-vif-unplugged-c463ae05-66b4-4234-8fdb-7f449078b8e6 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG os_brick.utils [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bad9a67-6e1d-4d99-95f9-271b6681fd1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a1340f-59a1-45af-9a29-eef137e12471]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1a5856-f854-40b6-ba1b-01a2d4d9edb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a039d7-cccf-4bf4-ab8b-e38930fa3b36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:14:21 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:14:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1e123b-9f21-49a6-a61e-76e6d6f9a00f]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG os_brick.utils [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:14:21 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Updating existing volume attachment record: bf43bc1e-af3c-49d9-abd5-151f3d7b9b15 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:14:22 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Instance destroyed successfully.
Aug 09 23:14:22 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lazy-loading 'resources' on Instance uuid e870efcb-fcb2-4dda-b92a-538fd06f16a7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:14:22 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-45550408',display_name='tempest-SnapshotDataIntegrityTests-server-45550408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-45550408',id=39,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9KKewf1o1KavPykvrzEet0vtqRfV4H4ollDfGqLgsLoj/drd85c6szCy59Plm0GlBGPxcr7Ka5fagayA0I8T6GKLR/xDQtaYg1/u2MSE8+jFygMy2zcnSsEMtbFafpLg==',key_name='tempest-keypair-1996619250',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:06:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28055127bfa44a1e8a8c2b79fae46838',ramdisk_id='',reservation_id='r-nvq9frw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1092360722',owner_user_name='tempest-SnapshotDataIntegrityTests-1092360722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:06:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3e3ad0b3d954ebd816dc6b7c0a863eb',uuid=e870efcb-fcb2-4dda-b92a-538fd06f16a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "address": "fa:16:3e:1e:a5:0b", "network": {"id": "a77ce7e5-f19c-4182-b6b9-52bdbd861868", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-539340574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28055127bfa44a1e8a8c2b79fae46838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc463ae05-66", "ovs_interfaceid": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:14:22 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Converting VIF {"id": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "address": "fa:16:3e:1e:a5:0b", "network": {"id": "a77ce7e5-f19c-4182-b6b9-52bdbd861868", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-539340574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28055127bfa44a1e8a8c2b79fae46838", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc463ae05-66", "ovs_interfaceid": "c463ae05-66b4-4234-8fdb-7f449078b8e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:14:22 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a5:0b,bridge_name='br-int',has_traffic_filtering=True,id=c463ae05-66b4-4234-8fdb-7f449078b8e6,network=Network(a77ce7e5-f19c-4182-b6b9-52bdbd861868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc463ae05-66') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:14:22 user nova-compute[72409]: DEBUG os_vif [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a5:0b,bridge_name='br-int',has_traffic_filtering=True,id=c463ae05-66b4-4234-8fdb-7f449078b8e6,network=Network(a77ce7e5-f19c-4182-b6b9-52bdbd861868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc463ae05-66') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:14:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc463ae05-66, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:14:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:14:22 user nova-compute[72409]: INFO os_vif [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a5:0b,bridge_name='br-int',has_traffic_filtering=True,id=c463ae05-66b4-4234-8fdb-7f449078b8e6,network=Network(a77ce7e5-f19c-4182-b6b9-52bdbd861868),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc463ae05-66')
Aug 09 23:14:22 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Deleting instance files /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7_del
Aug 09 23:14:22 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Deletion of /opt/stack/data/nova/instances/e870efcb-fcb2-4dda-b92a-538fd06f16a7_del complete
Aug 09 23:14:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:22 user nova-compute[72409]: INFO nova.compute.manager [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 23:14:22 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:14:22 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:14:22 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:14:23 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:14:23 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Took 1.28 seconds to deallocate network for instance.
Aug 09 23:14:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:14:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:14:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-839be4b4-1d92-4061-86bb-636d5a0ede87 req-962e375e-bfcb-4559-8fac-52a7f1b34917 service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Received event network-vif-plugged-c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:14:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-839be4b4-1d92-4061-86bb-636d5a0ede87 req-962e375e-bfcb-4559-8fac-52a7f1b34917 service nova] Acquiring lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:14:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-839be4b4-1d92-4061-86bb-636d5a0ede87 req-962e375e-bfcb-4559-8fac-52a7f1b34917 service nova] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:14:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-839be4b4-1d92-4061-86bb-636d5a0ede87 req-962e375e-bfcb-4559-8fac-52a7f1b34917 service nova] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:14:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-839be4b4-1d92-4061-86bb-636d5a0ede87 req-962e375e-bfcb-4559-8fac-52a7f1b34917 service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] No waiting events found dispatching network-vif-plugged-c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:14:23 user nova-compute[72409]: WARNING nova.compute.manager [req-839be4b4-1d92-4061-86bb-636d5a0ede87 req-962e375e-bfcb-4559-8fac-52a7f1b34917 service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Received unexpected event network-vif-plugged-c463ae05-66b4-4234-8fdb-7f449078b8e6 for instance with vm_state deleted and task_state None.
Aug 09 23:14:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-839be4b4-1d92-4061-86bb-636d5a0ede87 req-962e375e-bfcb-4559-8fac-52a7f1b34917 service nova] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Received event network-vif-deleted-c463ae05-66b4-4234-8fdb-7f449078b8e6 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:14:23 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:14:23 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:14:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:14:23 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Deleted allocations for instance e870efcb-fcb2-4dda-b92a-538fd06f16a7
Aug 09 23:14:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9bba856e-9b04-48b4-ac1a-989817946bf7 tempest-SnapshotDataIntegrityTests-1092360722 tempest-SnapshotDataIntegrityTests-1092360722-project-member] Lock "e870efcb-fcb2-4dda-b92a-538fd06f16a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.672s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:14:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvhsIfFD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:14:30 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:14:30 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:14:30 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ee9f4f-a58b-4d39-9bdf-55556f29209d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:14:30 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5886c2fc-6c3f-4158-aebd-0644e5a93d03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9] added
Aug 09 23:14:30 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa2c5d5-04f7-4bec-8625-360183033a39]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[73de8a9c-37c5-4ab8-b36e-3ec85da66cde]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvhsIfFD {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvhsIfFD" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b857dbc4-9fe0-47e7-9a02-b20ded419e86]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LvhsIfFD'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe430755-fd4b-42d8-b6bd-80b4b295bdbe]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc684f3-d7d2-4f4a-ad83-9afb4f06787e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:14:30 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:14:30 user nova-compute[72409]:  {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:14:30 user nova-compute[72409]: WARNING os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 23:14:30 user nova-compute[72409]: 
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44373c6-51a3-422e-b337-1a26fbc8f8ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9, portal: 172.16.0.220,3260]
Aug 09 23:14:30 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9, portal: 172.16.0.220,3260] successful.
Aug 09 23:14:30 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84202ab-eb92-4d63-a742-51ab86f42819]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c121d1-06c1-4d19-acd4-06a14868445b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 (non-flash)
Aug 09 23:14:30 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 (non-flash)
Aug 09 23:14:30 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9880aab9-1d66-4739-9dc4-6244c26fbb44]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:30 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:14:31 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:14:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvhsIfFD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:14:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:14:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26464383437643665', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:14:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464383437643665', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:14:31 user nova-compute[72409]: DEBUG nova.objects.instance [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lazy-loading 'flavor' on Instance uuid 5a24033f-5bf1-4747-a8f4-3edc32600a9a {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:14:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:14:31 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:14:31 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:14:31 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:14:31 user nova-compute[72409]:   <serial>4b2cbabd-53d2-483d-b44d-d09464cb2ec9</serial>
Aug 09 23:14:31 user nova-compute[72409]: </disk>
Aug 09 23:14:31 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:14:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:14:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:14:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] No VIF found with MAC fa:16:3e:91:b5:d2, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:14:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-ab7a29a9-5b81-424a-9141-d96c873aef6b tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.357s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:14:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:14:34 user nova-compute[72409]: INFO nova.compute.manager [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Detaching volume 4b2cbabd-53d2-483d-b44d-d09464cb2ec9
Aug 09 23:14:34 user nova-compute[72409]: INFO nova.virt.block_device [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Attempting to driver detach volume 4b2cbabd-53d2-483d-b44d-d09464cb2ec9 from mountpoint /dev/vdb
Aug 09 23:14:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Attempting to detach device vdb from instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:14:34 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:14:34 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:14:34 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:14:34 user nova-compute[72409]:   <serial>4b2cbabd-53d2-483d-b44d-d09464cb2ec9</serial>
Aug 09 23:14:34 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:14:34 user nova-compute[72409]: </disk>
Aug 09 23:14:34 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:14:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Successfully detached device vdb from instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a from the persistent domain config.
Aug 09 23:14:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:14:34 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:14:34 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:14:34 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:14:34 user nova-compute[72409]:   <serial>4b2cbabd-53d2-483d-b44d-d09464cb2ec9</serial>
Aug 09 23:14:34 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:14:34 user nova-compute[72409]: </disk>
Aug 09 23:14:34 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691622874.5502138, 5a24033f-5bf1-4747-a8f4-3edc32600a9a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:14:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Successfully detached device vdb from instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a from the live domain config.
Aug 09 23:14:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvhsIfFD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:14:34 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[73be751e-9ed1-4801-9e3a-abf986886637]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e863072-8764-4e59-9566-3d379f14f6f9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 (non-flash)
Aug 09 23:14:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 (non-flash)
Aug 09 23:14:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e9c218820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[666ac9a8-e4a7-4e4d-91a6-2fba7fb8a079]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[393885ba-c08d-42c1-9659-3c6e3863da05]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[901cbacc-507e-4469-99a4-1addc4de8c1c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db15eae-19f3-4ecf-87f5-5d3e7c923702]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad1ad14-d276-49e0-8213-dadcbbe758fa]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e28d312-de9a-4029-9b23-aba6a8e8bea3]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9, portal: 172.16.0.220,3260]
Aug 09 23:14:34 user nova-compute[72409]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9, portal: 172.16.0.220,3260] successful.
Aug 09 23:14:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b2cbabd-53d2-483d-b44d-d09464cb2ec9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a91374-a9fc-45c5-adaf-48aa07de6cc7]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.244s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] <== disconnect_volume: return (246ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:14:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:14:35 user nova-compute[72409]: DEBUG nova.objects.instance [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lazy-loading 'flavor' on Instance uuid 5a24033f-5bf1-4747-a8f4-3edc32600a9a {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:14:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-95cf6a61-5ee5-4c10-8745-e744438df2a9 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.532s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:14:37 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622862.0601385, e870efcb-fcb2-4dda-b92a-538fd06f16a7 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:14:37 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] VM Stopped (Lifecycle Event)
Aug 09 23:14:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-423b24d5-3807-4226-8975-302859a442b6 None None] [instance: e870efcb-fcb2-4dda-b92a-538fd06f16a7] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:14:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:14:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:15:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:15:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:15:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:15:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:05 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:15:06 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:15:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:15:07 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:15:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:07 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:08 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:09 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:10 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:15:10 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:15:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8280MB free_disk=25.28293228149414GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 76e542ee-fc49-430c-b2c3-2cd2913075a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:15:10 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:15:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:15:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:15:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:15:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:16 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:15:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:15:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:15:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:15:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:15:16 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:15:16 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:17 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Updating instance_info_cache with network_info: [{"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:15:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:15:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:15:17 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:15:17 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:15:17 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:15:17 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:15:17 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:15:17 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:15:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:26 user nova-compute[72409]: DEBUG nova.compute.manager [req-bd37266a-5939-4cb5-be81-7ec73be5648a req-711f6f8c-a642-4bac-94f7-6841ef6b41b8 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-changed-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:15:26 user nova-compute[72409]: DEBUG nova.compute.manager [req-bd37266a-5939-4cb5-be81-7ec73be5648a req-711f6f8c-a642-4bac-94f7-6841ef6b41b8 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Refreshing instance network info cache due to event network-changed-051b3c51-4821-4807-b65f-f5fe5894509c. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:15:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bd37266a-5939-4cb5-be81-7ec73be5648a req-711f6f8c-a642-4bac-94f7-6841ef6b41b8 service nova] Acquiring lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:15:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bd37266a-5939-4cb5-be81-7ec73be5648a req-711f6f8c-a642-4bac-94f7-6841ef6b41b8 service nova] Acquired lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:15:26 user nova-compute[72409]: DEBUG nova.network.neutron [req-bd37266a-5939-4cb5-be81-7ec73be5648a req-711f6f8c-a642-4bac-94f7-6841ef6b41b8 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Refreshing network info cache for port 051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:15:27 user nova-compute[72409]: DEBUG nova.network.neutron [req-bd37266a-5939-4cb5-be81-7ec73be5648a req-711f6f8c-a642-4bac-94f7-6841ef6b41b8 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updated VIF entry in instance network info cache for port 051b3c51-4821-4807-b65f-f5fe5894509c. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:15:27 user nova-compute[72409]: DEBUG nova.network.neutron [req-bd37266a-5939-4cb5-be81-7ec73be5648a req-711f6f8c-a642-4bac-94f7-6841ef6b41b8 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updating instance_info_cache with network_info: [{"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:15:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bd37266a-5939-4cb5-be81-7ec73be5648a req-711f6f8c-a642-4bac-94f7-6841ef6b41b8 service nova] Releasing lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:15:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:30 user nova-compute[72409]: DEBUG nova.objects.instance [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:30 user nova-compute[72409]: INFO nova.compute.manager [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Attaching volume 898c2d38-0af8-48cb-88f1-b66fcb4d1890 to /dev/vdb
Aug 09 23:15:30 user nova-compute[72409]: DEBUG os_brick.utils [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:15:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[542adc00-03ce-4c60-b9c4-2f39f04c5f6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55cb86b-13c0-4415-af78-387eb6d6b496]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e18167b-fbf3-4411-9234-9f98fb04fcb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d761d7-e7c3-403d-8b8a-c23ff3853faa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:15:31 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57b366e-b8fd-4caa-81af-146d0d4c75ad]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG os_brick.utils [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updating existing volume attachment record: 1dd5272e-63c7-46d5-879e-2cda429efb4b {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:15:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:15:31 user nova-compute[72409]: INFO nova.compute.manager [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] instance snapshotting
Aug 09 23:15:31 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Beginning live snapshot process
Aug 09 23:15:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json -f qcow2 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json -f qcow2 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq5lt6hdm/8e3c8c6888dc4b23bdae6367e74f4191.delta 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq5lt6hdm/8e3c8c6888dc4b23bdae6367e74f4191.delta 1073741824" returned: 0 in 0.047s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 23:15:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 23:15:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72409) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 23:15:33 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 23:15:33 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 23:15:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq5lt6hdm/8e3c8c6888dc4b23bdae6367e74f4191.delta /opt/stack/data/nova/instances/snapshots/tmpq5lt6hdm/8e3c8c6888dc4b23bdae6367e74f4191 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq5lt6hdm/8e3c8c6888dc4b23bdae6367e74f4191.delta /opt/stack/data/nova/instances/snapshots/tmpq5lt6hdm/8e3c8c6888dc4b23bdae6367e74f4191" returned: 0 in 0.620s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Snapshot extracted, beginning image upload
Aug 09 23:15:36 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Snapshot image upload complete
Aug 09 23:15:36 user nova-compute[72409]: INFO nova.compute.manager [None req-f960a1c2-b722-4dc8-a2e1-dd4f96c26999 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Took 4.88 seconds to snapshot the instance on the hypervisor.
Aug 09 23:15:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:15:38 user nova-compute[72409]: INFO nova.compute.claims [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Claim successful on node user
Aug 09 23:15:38 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG nova.network.neutron [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:15:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:15:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG nova.policy [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b61d55e8ee64a29932fdd5e96a1da9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b705695877154faabd0c75185ad73491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:15:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Creating image(s)
Aug 09 23:15:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "/opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "/opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "8933b5dc43db32ebaa20789efc5feb98ad9976a4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "8933b5dc43db32ebaa20789efc5feb98ad9976a4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4.part --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcsaMGmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:15:40 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:15:40 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:15:40 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4996ae18-f55d-45d5-9e79-29b0ff54d428]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:15:40 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f36321-0eef-4e42-9f7b-b907d06d4aa6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890] added
Aug 09 23:15:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4.part --force-share --output=json" returned: 0 in 0.159s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG nova.virt.images [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] a8eaf0c5-96e5-4a39-b520-67e61bf59271 was qcow2, converting to raw {{(pid=72409) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG nova.privsep.utils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72409) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4.part /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4.converted {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[09efedc2-8703-4566-bd8f-276e107828eb]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG nova.network.neutron [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Successfully created port: 24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e060c4d3-4551-4c16-98f4-58c5077affc3]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcsaMGmu {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcsaMGmu" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9786f2-b717-4169-af17-dbb93d323381]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcsaMGmu'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.055s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8ac0c3-1ae2-45c3-a1a8-23a697e5a178]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4209b8d0-0230-4e57-9dfb-b5f66aed5cbb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:15:40 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:15:40 user nova-compute[72409]:  {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:15:40 user nova-compute[72409]: WARNING os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 23:15:40 user nova-compute[72409]: 
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[989af765-d10f-4c79-9695-23eab4f0abf3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260]
Aug 09 23:15:40 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260] successful.
Aug 09 23:15:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a754f3-cd1f-4832-a950-a450a0967015]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82a9bf8-0078-4990-8671-5770eb8d5afd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:15:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:15:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced4ad0a-3e96-4578-b23c-fd105bcc7734]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcsaMGmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4.part /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4.converted" returned: 0 in 0.608s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4.converted --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "8933b5dc43db32ebaa20789efc5feb98ad9976a4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.146s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4 --force-share --output=json" returned: 0 in 0.195s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "8933b5dc43db32ebaa20789efc5feb98ad9976a4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "8933b5dc43db32ebaa20789efc5feb98ad9976a4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG nova.network.neutron [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Successfully updated port: 24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4 --force-share --output=json" returned: 0 in 0.192s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4,backing_fmt=raw /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23962306462363464', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962306462363464', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG nova.objects.instance [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "refresh_cache-7d1268b0-db1f-4974-a6ba-ac9c4189adb7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquired lock "refresh_cache-7d1268b0-db1f-4974-a6ba-ac9c4189adb7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG nova.network.neutron [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-d0cade7c-3220-47cc-ac44-2a112c9fd3f6 req-735cb934-a47c-4a56-8282-cbde03c4e86b service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Received event network-changed-24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-d0cade7c-3220-47cc-ac44-2a112c9fd3f6 req-735cb934-a47c-4a56-8282-cbde03c4e86b service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Refreshing instance network info cache due to event network-changed-24e18d51-d819-4195-a1a9-12555bb6a648. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d0cade7c-3220-47cc-ac44-2a112c9fd3f6 req-735cb934-a47c-4a56-8282-cbde03c4e86b service nova] Acquiring lock "refresh_cache-7d1268b0-db1f-4974-a6ba-ac9c4189adb7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4,backing_fmt=raw /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk 1073741824" returned: 0 in 0.188s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "8933b5dc43db32ebaa20789efc5feb98ad9976a4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.385s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4 --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:15:41 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:15:41 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:15:41 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:15:41 user nova-compute[72409]:   <serial>898c2d38-0af8-48cb-88f1-b66fcb4d1890</serial>
Aug 09 23:15:41 user nova-compute[72409]: </disk>
Aug 09 23:15:41 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG nova.network.neutron [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4 --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG nova.objects.instance [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lazy-loading 'migration_context' on Instance uuid 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Ensure instance console log exists: /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.network.neutron [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Updating instance_info_cache with network_info: [{"id": "24e18d51-d819-4195-a1a9-12555bb6a648", "address": "fa:16:3e:4a:ba:90", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e18d51-d8", "ovs_interfaceid": "24e18d51-d819-4195-a1a9-12555bb6a648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Releasing lock "refresh_cache-7d1268b0-db1f-4974-a6ba-ac9c4189adb7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Instance network_info: |[{"id": "24e18d51-d819-4195-a1a9-12555bb6a648", "address": "fa:16:3e:4a:ba:90", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e18d51-d8", "ovs_interfaceid": "24e18d51-d819-4195-a1a9-12555bb6a648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d0cade7c-3220-47cc-ac44-2a112c9fd3f6 req-735cb934-a47c-4a56-8282-cbde03c4e86b service nova] Acquired lock "refresh_cache-7d1268b0-db1f-4974-a6ba-ac9c4189adb7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.network.neutron [req-d0cade7c-3220-47cc-ac44-2a112c9fd3f6 req-735cb934-a47c-4a56-8282-cbde03c4e86b service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Refreshing network info cache for port 24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Start _get_guest_xml network_info=[{"id": "24e18d51-d819-4195-a1a9-12555bb6a648", "address": "fa:16:3e:4a:ba:90", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e18d51-d8", "ovs_interfaceid": "24e18d51-d819-4195-a1a9-12555bb6a648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='adf0fef6db7425cc6ce4d3aaa11d2f84',container_format='bare',created_at=2023-08-09T23:15:31Z,direct_url=<?>,disk_format='qcow2',id=a8eaf0c5-96e5-4a39-b520-67e61bf59271,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1295618050',owner='b705695877154faabd0c75185ad73491',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T23:15:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': 'a8eaf0c5-96e5-4a39-b520-67e61bf59271'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:15:42 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:15:42 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='adf0fef6db7425cc6ce4d3aaa11d2f84',container_format='bare',created_at=2023-08-09T23:15:31Z,direct_url=<?>,disk_format='qcow2',id=a8eaf0c5-96e5-4a39-b520-67e61bf59271,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1295618050',owner='b705695877154faabd0c75185ad73491',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T23:15:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1113876708',display_name='tempest-TestStampPattern-server-1113876708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1113876708',id=45,image_ref='a8eaf0c5-96e5-4a39-b520-67e61bf59271',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACqTN5JNJboA9fuy5/UTb+uTv5M7CNRxzTTBTq5qMrCSjkVTX26zZ8ycWZWQgsh8TUujt/vkEhg0GyHg4LEyMi1LYTUUsuY0vv4GJj3S4KwV8eNTp0vV4370y1nJlwPHw==',key_name='tempest-TestStampPattern-1134071202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b705695877154faabd0c75185ad73491',ramdisk_id='',reservation_id='r-yx7vrlx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5a24033f-5bf1-4747-a8f4-3edc32600a9a',image_min_disk='1',image_min_ram='0',image_owner_id='b705695877154faabd0c75185ad73491',image_owner_project_name='tempest-TestStampPattern-322079569',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-322079569-project-member',image_user_id='4b61d55e8ee64a29932fdd5e96a1da9a',network_allocated='True',owner_project_name='tempest-TestStampPattern-322079569',owner_user_name='tempest-TestStampPattern-322079569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:15:39Z,user_data=None,user_id='4b61d55e8ee64a29932fdd5e96a1da9a',uuid=7d1268b0-db1f-4974-a6ba-ac9c4189adb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24e18d51-d819-4195-a1a9-12555bb6a648", "address": "fa:16:3e:4a:ba:90", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e18d51-d8", "ovs_interfaceid": "24e18d51-d819-4195-a1a9-12555bb6a648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Converting VIF {"id": "24e18d51-d819-4195-a1a9-12555bb6a648", "address": "fa:16:3e:4a:ba:90", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e18d51-d8", "ovs_interfaceid": "24e18d51-d819-4195-a1a9-12555bb6a648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ba:90,bridge_name='br-int',has_traffic_filtering=True,id=24e18d51-d819-4195-a1a9-12555bb6a648,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e18d51-d8') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.objects.instance [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No VIF found with MAC fa:16:3e:19:e9:13, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:15:42 user nova-compute[72409]:   <uuid>7d1268b0-db1f-4974-a6ba-ac9c4189adb7</uuid>
Aug 09 23:15:42 user nova-compute[72409]:   <name>instance-0000002d</name>
Aug 09 23:15:42 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:15:42 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:15:42 user nova-compute[72409]:   <metadata>
Aug 09 23:15:42 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:15:42 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:15:42 user nova-compute[72409]:       <nova:name>tempest-TestStampPattern-server-1113876708</nova:name>
Aug 09 23:15:42 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:15:42</nova:creationTime>
Aug 09 23:15:42 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:15:42 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:15:42 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:15:42 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:15:42 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:15:42 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:15:42 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:15:42 user nova-compute[72409]:       <nova:owner>
Aug 09 23:15:42 user nova-compute[72409]:         <nova:user uuid="4b61d55e8ee64a29932fdd5e96a1da9a">tempest-TestStampPattern-322079569-project-member</nova:user>
Aug 09 23:15:42 user nova-compute[72409]:         <nova:project uuid="b705695877154faabd0c75185ad73491">tempest-TestStampPattern-322079569</nova:project>
Aug 09 23:15:42 user nova-compute[72409]:       </nova:owner>
Aug 09 23:15:42 user nova-compute[72409]:       <nova:root type="image" uuid="a8eaf0c5-96e5-4a39-b520-67e61bf59271"/>
Aug 09 23:15:42 user nova-compute[72409]:       <nova:ports>
Aug 09 23:15:42 user nova-compute[72409]:         <nova:port uuid="24e18d51-d819-4195-a1a9-12555bb6a648">
Aug 09 23:15:42 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 23:15:42 user nova-compute[72409]:         </nova:port>
Aug 09 23:15:42 user nova-compute[72409]:       </nova:ports>
Aug 09 23:15:42 user nova-compute[72409]:     </nova:instance>
Aug 09 23:15:42 user nova-compute[72409]:   </metadata>
Aug 09 23:15:42 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:15:42 user nova-compute[72409]:     <system>
Aug 09 23:15:42 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:15:42 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:15:42 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:15:42 user nova-compute[72409]:       <entry name="serial">7d1268b0-db1f-4974-a6ba-ac9c4189adb7</entry>
Aug 09 23:15:42 user nova-compute[72409]:       <entry name="uuid">7d1268b0-db1f-4974-a6ba-ac9c4189adb7</entry>
Aug 09 23:15:42 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:15:42 user nova-compute[72409]:     </system>
Aug 09 23:15:42 user nova-compute[72409]:   </sysinfo>
Aug 09 23:15:42 user nova-compute[72409]:   <os>
Aug 09 23:15:42 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:15:42 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:15:42 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:15:42 user nova-compute[72409]:   </os>
Aug 09 23:15:42 user nova-compute[72409]:   <features>
Aug 09 23:15:42 user nova-compute[72409]:     <acpi/>
Aug 09 23:15:42 user nova-compute[72409]:     <apic/>
Aug 09 23:15:42 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:15:42 user nova-compute[72409]:   </features>
Aug 09 23:15:42 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:15:42 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:15:42 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:15:42 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:15:42 user nova-compute[72409]:   </clock>
Aug 09 23:15:42 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:15:42 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:15:42 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:15:42 user nova-compute[72409]:   </cpu>
Aug 09 23:15:42 user nova-compute[72409]:   <devices>
Aug 09 23:15:42 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:15:42 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:15:42 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk"/>
Aug 09 23:15:42 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:15:42 user nova-compute[72409]:     </disk>
Aug 09 23:15:42 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:15:42 user nova-compute[72409]:       <mac address="fa:16:3e:4a:ba:90"/>
Aug 09 23:15:42 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:15:42 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:15:42 user nova-compute[72409]:       <target dev="tap24e18d51-d8"/>
Aug 09 23:15:42 user nova-compute[72409]:     </interface>
Aug 09 23:15:42 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:15:42 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/console.log" append="off"/>
Aug 09 23:15:42 user nova-compute[72409]:     </serial>
Aug 09 23:15:42 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:15:42 user nova-compute[72409]:     <video>
Aug 09 23:15:42 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:15:42 user nova-compute[72409]:     </video>
Aug 09 23:15:42 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:15:42 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:15:42 user nova-compute[72409]:     </rng>
Aug 09 23:15:42 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:15:42 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:15:42 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:15:42 user nova-compute[72409]:     </memballoon>
Aug 09 23:15:42 user nova-compute[72409]:   </devices>
Aug 09 23:15:42 user nova-compute[72409]: </domain>
Aug 09 23:15:42 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1113876708',display_name='tempest-TestStampPattern-server-1113876708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1113876708',id=45,image_ref='a8eaf0c5-96e5-4a39-b520-67e61bf59271',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACqTN5JNJboA9fuy5/UTb+uTv5M7CNRxzTTBTq5qMrCSjkVTX26zZ8ycWZWQgsh8TUujt/vkEhg0GyHg4LEyMi1LYTUUsuY0vv4GJj3S4KwV8eNTp0vV4370y1nJlwPHw==',key_name='tempest-TestStampPattern-1134071202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b705695877154faabd0c75185ad73491',ramdisk_id='',reservation_id='r-yx7vrlx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5a24033f-5bf1-4747-a8f4-3edc32600a9a',image_min_disk='1',image_min_ram='0',image_owner_id='b705695877154faabd0c75185ad73491',image_owner_project_name='tempest-TestStampPattern-322079569',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-322079569-project-member',image_user_id='4b61d55e8ee64a29932fdd5e96a1da9a',network_allocated='True',owner_project_name='tempest-TestStampPattern-322079569',owner_user_name='tempest-TestStampPattern-322079569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:15:39Z,user_data=None,user_id='4b61d55e8ee64a29932fdd5e96a1da9a',uuid=7d1268b0-db1f-4974-a6ba-ac9c4189adb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24e18d51-d819-4195-a1a9-12555bb6a648", "address": "fa:16:3e:4a:ba:90", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e18d51-d8", "ovs_interfaceid": "24e18d51-d819-4195-a1a9-12555bb6a648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Converting VIF {"id": "24e18d51-d819-4195-a1a9-12555bb6a648", "address": "fa:16:3e:4a:ba:90", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e18d51-d8", "ovs_interfaceid": "24e18d51-d819-4195-a1a9-12555bb6a648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ba:90,bridge_name='br-int',has_traffic_filtering=True,id=24e18d51-d819-4195-a1a9-12555bb6a648,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e18d51-d8') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG os_vif [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ba:90,bridge_name='br-int',has_traffic_filtering=True,id=24e18d51-d819-4195-a1a9-12555bb6a648,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e18d51-d8') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24e18d51-d8, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24e18d51-d8, col_values=(('external_ids', {'iface-id': '24e18d51-d819-4195-a1a9-12555bb6a648', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:ba:90', 'vm-uuid': '7d1268b0-db1f-4974-a6ba-ac9c4189adb7'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:42 user nova-compute[72409]: INFO os_vif [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ba:90,bridge_name='br-int',has_traffic_filtering=True,id=24e18d51-d819-4195-a1a9-12555bb6a648,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e18d51-d8')
Aug 09 23:15:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] No VIF found with MAC fa:16:3e:4a:ba:90, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-de40f514-e624-4ed0-a6f4-f37acaffba2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.375s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.network.neutron [req-d0cade7c-3220-47cc-ac44-2a112c9fd3f6 req-735cb934-a47c-4a56-8282-cbde03c4e86b service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Updated VIF entry in instance network info cache for port 24e18d51-d819-4195-a1a9-12555bb6a648. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.network.neutron [req-d0cade7c-3220-47cc-ac44-2a112c9fd3f6 req-735cb934-a47c-4a56-8282-cbde03c4e86b service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Updating instance_info_cache with network_info: [{"id": "24e18d51-d819-4195-a1a9-12555bb6a648", "address": "fa:16:3e:4a:ba:90", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e18d51-d8", "ovs_interfaceid": "24e18d51-d819-4195-a1a9-12555bb6a648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d0cade7c-3220-47cc-ac44-2a112c9fd3f6 req-735cb934-a47c-4a56-8282-cbde03c4e86b service nova] Releasing lock "refresh_cache-7d1268b0-db1f-4974-a6ba-ac9c4189adb7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1959e105-1950-45df-bb75-3d1d0ebcc9e7 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1959e105-1950-45df-bb75-3d1d0ebcc9e7 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1959e105-1950-45df-bb75-3d1d0ebcc9e7 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1959e105-1950-45df-bb75-3d1d0ebcc9e7 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72409) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 23:15:42 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1959e105-1950-45df-bb75-3d1d0ebcc9e7 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-e68e1cc3-36b6-4c6a-8829-3beb15cab1f1 req-7b93de1a-836a-4e14-95fb-d2039bbf37e7 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-unplugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e68e1cc3-36b6-4c6a-8829-3beb15cab1f1 req-7b93de1a-836a-4e14-95fb-d2039bbf37e7 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e68e1cc3-36b6-4c6a-8829-3beb15cab1f1 req-7b93de1a-836a-4e14-95fb-d2039bbf37e7 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e68e1cc3-36b6-4c6a-8829-3beb15cab1f1 req-7b93de1a-836a-4e14-95fb-d2039bbf37e7 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-e68e1cc3-36b6-4c6a-8829-3beb15cab1f1 req-7b93de1a-836a-4e14-95fb-d2039bbf37e7 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-unplugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:15:43 user nova-compute[72409]: WARNING nova.compute.manager [req-e68e1cc3-36b6-4c6a-8829-3beb15cab1f1 req-7b93de1a-836a-4e14-95fb-d2039bbf37e7 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-unplugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state active and task_state powering-off.
Aug 09 23:15:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-e68e1cc3-36b6-4c6a-8829-3beb15cab1f1 req-7b93de1a-836a-4e14-95fb-d2039bbf37e7 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e68e1cc3-36b6-4c6a-8829-3beb15cab1f1 req-7b93de1a-836a-4e14-95fb-d2039bbf37e7 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e68e1cc3-36b6-4c6a-8829-3beb15cab1f1 req-7b93de1a-836a-4e14-95fb-d2039bbf37e7 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e68e1cc3-36b6-4c6a-8829-3beb15cab1f1 req-7b93de1a-836a-4e14-95fb-d2039bbf37e7 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-e68e1cc3-36b6-4c6a-8829-3beb15cab1f1 req-7b93de1a-836a-4e14-95fb-d2039bbf37e7 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:15:43 user nova-compute[72409]: WARNING nova.compute.manager [req-e68e1cc3-36b6-4c6a-8829-3beb15cab1f1 req-7b93de1a-836a-4e14-95fb-d2039bbf37e7 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state active and task_state powering-off.
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-ad22c138-1068-480d-bc91-de9e67afde4d req-8a5cee62-9ce7-48f4-8517-aec5e50b1f1e service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Received event network-vif-plugged-24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ad22c138-1068-480d-bc91-de9e67afde4d req-8a5cee62-9ce7-48f4-8517-aec5e50b1f1e service nova] Acquiring lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ad22c138-1068-480d-bc91-de9e67afde4d req-8a5cee62-9ce7-48f4-8517-aec5e50b1f1e service nova] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ad22c138-1068-480d-bc91-de9e67afde4d req-8a5cee62-9ce7-48f4-8517-aec5e50b1f1e service nova] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG nova.compute.manager [req-ad22c138-1068-480d-bc91-de9e67afde4d req-8a5cee62-9ce7-48f4-8517-aec5e50b1f1e service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] No waiting events found dispatching network-vif-plugged-24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:15:43 user nova-compute[72409]: WARNING nova.compute.manager [req-ad22c138-1068-480d-bc91-de9e67afde4d req-8a5cee62-9ce7-48f4-8517-aec5e50b1f1e service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Received unexpected event network-vif-plugged-24e18d51-d819-4195-a1a9-12555bb6a648 for instance with vm_state building and task_state spawning.
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance destroyed successfully.
Aug 09 23:15:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1959e105-1950-45df-bb75-3d1d0ebcc9e7 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:15:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1959e105-1950-45df-bb75-3d1d0ebcc9e7 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.512s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:15:45 user nova-compute[72409]: WARNING nova.compute.manager [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state stopped and task_state None.
Aug 09 23:15:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:15:45 user nova-compute[72409]: WARNING nova.compute.manager [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state stopped and task_state None.
Aug 09 23:15:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-unplugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-unplugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:15:45 user nova-compute[72409]: WARNING nova.compute.manager [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-unplugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state stopped and task_state None.
Aug 09 23:15:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:15:45 user nova-compute[72409]: WARNING nova.compute.manager [req-05b8fb84-53d7-42a6-aeec-e60ec1671101 req-92792d1b-c496-47c9-b2ff-531ea86d1a06 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state stopped and task_state None.
Aug 09 23:15:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-9ba89b43-aa77-48da-9e30-e12ad358b97e req-d8bd9c8f-2bea-4863-8a13-9d979615b598 service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Received event network-vif-plugged-24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9ba89b43-aa77-48da-9e30-e12ad358b97e req-d8bd9c8f-2bea-4863-8a13-9d979615b598 service nova] Acquiring lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9ba89b43-aa77-48da-9e30-e12ad358b97e req-d8bd9c8f-2bea-4863-8a13-9d979615b598 service nova] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-9ba89b43-aa77-48da-9e30-e12ad358b97e req-d8bd9c8f-2bea-4863-8a13-9d979615b598 service nova] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-9ba89b43-aa77-48da-9e30-e12ad358b97e req-d8bd9c8f-2bea-4863-8a13-9d979615b598 service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] No waiting events found dispatching network-vif-plugged-24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:15:45 user nova-compute[72409]: WARNING nova.compute.manager [req-9ba89b43-aa77-48da-9e30-e12ad358b97e req-d8bd9c8f-2bea-4863-8a13-9d979615b598 service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Received unexpected event network-vif-plugged-24e18d51-d819-4195-a1a9-12555bb6a648 for instance with vm_state building and task_state spawning.
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622946.1577978, 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:15:46 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] VM Resumed (Lifecycle Event)
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:15:46 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Instance spawned successfully.
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:15:46 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622946.1620226, 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:15:46 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] VM Started (Lifecycle Event)
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:15:46 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:46 user nova-compute[72409]: INFO nova.compute.manager [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Took 7.50 seconds to spawn the instance on the hypervisor.
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.compute.manager [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.objects.instance [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'flavor' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:46 user nova-compute[72409]: INFO nova.compute.manager [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Took 8.16 seconds to build instance.
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-894bec09-8ca6-4d55-b501-fb79e136de09 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.250s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:46 user nova-compute[72409]: INFO nova.compute.manager [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Attaching volume ad3e297f-025b-49cf-9968-9c1ae75cfe0a to /dev/vdb
Aug 09 23:15:46 user nova-compute[72409]: DEBUG os_brick.utils [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca96c75-72a6-45a4-a977-d71947fdc82f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[257b3375-3ee0-47bc-a102-34ae338396ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c91da2-acc1-4e50-84b5-6504ab19faaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ee074c-5a2c-472f-b6f9-e52bc38587e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:15:46 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:15:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b610ec9-2c7c-489c-a147-8aa1390e541c]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG os_brick.utils [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:15:46 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updating existing volume attachment record: 27b51287-1676-4e4d-80d9-191adaef2b94 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:15:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:47 user nova-compute[72409]: DEBUG nova.compute.manager [req-62407d26-7462-4402-b6f8-bbe81221ec68 req-31a0fe8d-7bad-4b2e-8ffd-0653b16284ac service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-changed-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:15:47 user nova-compute[72409]: DEBUG nova.compute.manager [req-62407d26-7462-4402-b6f8-bbe81221ec68 req-31a0fe8d-7bad-4b2e-8ffd-0653b16284ac service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Refreshing instance network info cache due to event network-changed-d115dd28-4650-4494-8fb0-d387a77b1600. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:15:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-62407d26-7462-4402-b6f8-bbe81221ec68 req-31a0fe8d-7bad-4b2e-8ffd-0653b16284ac service nova] Acquiring lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:15:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-62407d26-7462-4402-b6f8-bbe81221ec68 req-31a0fe8d-7bad-4b2e-8ffd-0653b16284ac service nova] Acquired lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:15:47 user nova-compute[72409]: DEBUG nova.network.neutron [req-62407d26-7462-4402-b6f8-bbe81221ec68 req-31a0fe8d-7bad-4b2e-8ffd-0653b16284ac service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Refreshing network info cache for port d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:15:48 user nova-compute[72409]: DEBUG nova.network.neutron [req-62407d26-7462-4402-b6f8-bbe81221ec68 req-31a0fe8d-7bad-4b2e-8ffd-0653b16284ac service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updated VIF entry in instance network info cache for port d115dd28-4650-4494-8fb0-d387a77b1600. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:15:48 user nova-compute[72409]: DEBUG nova.network.neutron [req-62407d26-7462-4402-b6f8-bbe81221ec68 req-31a0fe8d-7bad-4b2e-8ffd-0653b16284ac service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updating instance_info_cache with network_info: [{"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:15:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-62407d26-7462-4402-b6f8-bbe81221ec68 req-31a0fe8d-7bad-4b2e-8ffd-0653b16284ac service nova] Releasing lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:15:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBwEuNmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:15:55 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:15:55 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:15:55 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e25206-9913-44d2-85cc-7e45bbe8c9a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:15:55 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0597ae3-f3a9-4f66-87ae-7da83e090320]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a] added
Aug 09 23:15:55 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff51aa05-f995-4e28-b64f-b3befaff0c8e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ffc40d-43a0-4c0a-9eb4-62bbb74da815]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBwEuNmz {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBwEuNmz" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7522ac38-cb5c-46e7-a130-ba2566df8ea7]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBwEuNmz'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6e41fe-ace7-472e-a82d-0d4461be2e86]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23a0d66-cc3c-4107-958d-0eb2d8488e2f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:15:55 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:15:55 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[403ddf37-cc0a-41f3-b6ec-cf50b6ee147e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a, portal: 172.16.0.220,3260]
Aug 09 23:15:55 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a, portal: 172.16.0.220,3260] successful.
Aug 09 23:15:55 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef95571-01cc-46ce-984e-0414fdfa48df]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[97446c20-3bc8-4090-8dfa-f35b97dc6576]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:15:55 user nova-compute[72409]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:15:55 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:15:55 user nova-compute[72409]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:15:55 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f10b634-6b72-4151-95ca-3c3542780b5d]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:15:55 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBwEuNmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:15:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:15:56 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26434393532616561', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:15:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434393532616561', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:15:56 user nova-compute[72409]: DEBUG nova.objects.instance [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'flavor' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:15:56 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:15:56 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:15:56 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:15:56 user nova-compute[72409]:   <serial>ad3e297f-025b-49cf-9968-9c1ae75cfe0a</serial>
Aug 09 23:15:56 user nova-compute[72409]: </disk>
Aug 09 23:15:56 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:15:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:15:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:15:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No VIF found with MAC fa:16:3e:68:90:c5, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:15:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-942d29b3-d8d7-44ea-9ba6-ea8d2b5330aa tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.516s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:57 user nova-compute[72409]: INFO nova.compute.manager [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Rescuing
Aug 09 23:15:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:15:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquired lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:15:57 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:15:58 user nova-compute[72409]: DEBUG nova.network.neutron [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updating instance_info_cache with network_info: [{"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:15:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Releasing lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:15:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:58 user nova-compute[72409]: DEBUG nova.compute.manager [req-26619629-fbc7-4f09-b6f0-e6e90e955070 req-3c9643ca-0284-438f-b208-13b182af09f9 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-unplugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:15:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-26619629-fbc7-4f09-b6f0-e6e90e955070 req-3c9643ca-0284-438f-b208-13b182af09f9 service nova] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-26619629-fbc7-4f09-b6f0-e6e90e955070 req-3c9643ca-0284-438f-b208-13b182af09f9 service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-26619629-fbc7-4f09-b6f0-e6e90e955070 req-3c9643ca-0284-438f-b208-13b182af09f9 service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:58 user nova-compute[72409]: DEBUG nova.compute.manager [req-26619629-fbc7-4f09-b6f0-e6e90e955070 req-3c9643ca-0284-438f-b208-13b182af09f9 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] No waiting events found dispatching network-vif-unplugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:15:58 user nova-compute[72409]: WARNING nova.compute.manager [req-26619629-fbc7-4f09-b6f0-e6e90e955070 req-3c9643ca-0284-438f-b208-13b182af09f9 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received unexpected event network-vif-unplugged-d115dd28-4650-4494-8fb0-d387a77b1600 for instance with vm_state active and task_state rescuing.
Aug 09 23:15:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:15:59 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Instance destroyed successfully.
Aug 09 23:15:59 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Attempting rescue
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72409) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Instance directory exists: not creating {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 23:15:59 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Creating image(s)
Aug 09 23:15:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "/opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "/opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "/opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.rescue {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691622944.3131402, c43b9b78-3237-4cb0-be8a-0b3ec6e53aba => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:15:59 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] VM Stopped (Lifecycle Event)
Aug 09 23:15:59 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.rescue" returned: 0 in 0.055s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'migration_context' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f9eaa31f-50b0-4d5b-a803-1eaca8932419 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Start _get_guest_xml network_info=[{"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "vif_mac": "fa:16:3e:68:90:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'resources' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-f9eaa31f-50b0-4d5b-a803-1eaca8932419 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'numa_topology' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:59 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:15:59 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-899627340',display_name='tempest-ServerRescueNegativeTestJSON-server-899627340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-899627340',id=44,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+Br0sqy7btjDPu+x0UxuVaCzJxyOFJSXaS/DTk5G+W8EKbv1EgqwSxTUZklmQSJqsdwz/nAqjT9MvfhoEmk2kJC5gxj7MsfxATlRr4Evjp0O4tu0pw/TG7W96oZ+VJRg==',key_name='tempest-keypair-960642969',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:14:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d41897ed2b644775a5dcb22d1ecd60a0',ramdisk_id='',reservation_id='r-v0xxbfd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-850997564',owner_user_name='tempest-ServerRescueNegativeTestJSON-850997564-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de2d9f7ad5bb4a93ab61ab100eb1778d',uuid=76e542ee-fc49-430c-b2c3-2cd2913075a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "vif_mac": "fa:16:3e:68:90:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converting VIF {"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "vif_mac": "fa:16:3e:68:90:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=d115dd28-4650-4494-8fb0-d387a77b1600,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115dd28-46') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.objects.instance [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'pci_devices' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:15:59 user nova-compute[72409]:   <uuid>76e542ee-fc49-430c-b2c3-2cd2913075a0</uuid>
Aug 09 23:15:59 user nova-compute[72409]:   <name>instance-0000002c</name>
Aug 09 23:15:59 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:15:59 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:15:59 user nova-compute[72409]:   <metadata>
Aug 09 23:15:59 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:15:59 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:15:59 user nova-compute[72409]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-899627340</nova:name>
Aug 09 23:15:59 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:15:59</nova:creationTime>
Aug 09 23:15:59 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:15:59 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:15:59 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:15:59 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:15:59 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:15:59 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:15:59 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:15:59 user nova-compute[72409]:       <nova:owner>
Aug 09 23:15:59 user nova-compute[72409]:         <nova:user uuid="de2d9f7ad5bb4a93ab61ab100eb1778d">tempest-ServerRescueNegativeTestJSON-850997564-project-member</nova:user>
Aug 09 23:15:59 user nova-compute[72409]:         <nova:project uuid="d41897ed2b644775a5dcb22d1ecd60a0">tempest-ServerRescueNegativeTestJSON-850997564</nova:project>
Aug 09 23:15:59 user nova-compute[72409]:       </nova:owner>
Aug 09 23:15:59 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:15:59 user nova-compute[72409]:       <nova:ports>
Aug 09 23:15:59 user nova-compute[72409]:         <nova:port uuid="d115dd28-4650-4494-8fb0-d387a77b1600">
Aug 09 23:15:59 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 23:15:59 user nova-compute[72409]:         </nova:port>
Aug 09 23:15:59 user nova-compute[72409]:       </nova:ports>
Aug 09 23:15:59 user nova-compute[72409]:     </nova:instance>
Aug 09 23:15:59 user nova-compute[72409]:   </metadata>
Aug 09 23:15:59 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:15:59 user nova-compute[72409]:     <system>
Aug 09 23:15:59 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:15:59 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:15:59 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:15:59 user nova-compute[72409]:       <entry name="serial">76e542ee-fc49-430c-b2c3-2cd2913075a0</entry>
Aug 09 23:15:59 user nova-compute[72409]:       <entry name="uuid">76e542ee-fc49-430c-b2c3-2cd2913075a0</entry>
Aug 09 23:15:59 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:15:59 user nova-compute[72409]:     </system>
Aug 09 23:15:59 user nova-compute[72409]:   </sysinfo>
Aug 09 23:15:59 user nova-compute[72409]:   <os>
Aug 09 23:15:59 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:15:59 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:15:59 user nova-compute[72409]:   </os>
Aug 09 23:15:59 user nova-compute[72409]:   <features>
Aug 09 23:15:59 user nova-compute[72409]:     <acpi/>
Aug 09 23:15:59 user nova-compute[72409]:     <apic/>
Aug 09 23:15:59 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:15:59 user nova-compute[72409]:   </features>
Aug 09 23:15:59 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:15:59 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:15:59 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:15:59 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:15:59 user nova-compute[72409]:   </clock>
Aug 09 23:15:59 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:15:59 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:15:59 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:15:59 user nova-compute[72409]:   </cpu>
Aug 09 23:15:59 user nova-compute[72409]:   <devices>
Aug 09 23:15:59 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:15:59 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:15:59 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.rescue"/>
Aug 09 23:15:59 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:15:59 user nova-compute[72409]:     </disk>
Aug 09 23:15:59 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:15:59 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:15:59 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk"/>
Aug 09 23:15:59 user nova-compute[72409]:       <target dev="vdb" bus="virtio"/>
Aug 09 23:15:59 user nova-compute[72409]:     </disk>
Aug 09 23:15:59 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:15:59 user nova-compute[72409]:       <mac address="fa:16:3e:68:90:c5"/>
Aug 09 23:15:59 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:15:59 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:15:59 user nova-compute[72409]:       <target dev="tapd115dd28-46"/>
Aug 09 23:15:59 user nova-compute[72409]:     </interface>
Aug 09 23:15:59 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:15:59 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/console.log" append="off"/>
Aug 09 23:15:59 user nova-compute[72409]:     </serial>
Aug 09 23:15:59 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:15:59 user nova-compute[72409]:     <video>
Aug 09 23:15:59 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:15:59 user nova-compute[72409]:     </video>
Aug 09 23:15:59 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:15:59 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:15:59 user nova-compute[72409]:     </rng>
Aug 09 23:15:59 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:15:59 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:15:59 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:15:59 user nova-compute[72409]:     </memballoon>
Aug 09 23:15:59 user nova-compute[72409]:   </devices>
Aug 09 23:15:59 user nova-compute[72409]: </domain>
Aug 09 23:15:59 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:15:59 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Instance destroyed successfully.
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] No VIF found with MAC fa:16:3e:68:90:c5, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:15:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 23:16:00 user nova-compute[72409]: DEBUG nova.compute.manager [req-d3f9c9ae-f749-482b-b490-e05b693feff5 req-caeff3fb-e887-40d9-abd5-50c5769b2b89 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:16:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d3f9c9ae-f749-482b-b490-e05b693feff5 req-caeff3fb-e887-40d9-abd5-50c5769b2b89 service nova] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:16:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d3f9c9ae-f749-482b-b490-e05b693feff5 req-caeff3fb-e887-40d9-abd5-50c5769b2b89 service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:16:00 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-d3f9c9ae-f749-482b-b490-e05b693feff5 req-caeff3fb-e887-40d9-abd5-50c5769b2b89 service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:16:00 user nova-compute[72409]: DEBUG nova.compute.manager [req-d3f9c9ae-f749-482b-b490-e05b693feff5 req-caeff3fb-e887-40d9-abd5-50c5769b2b89 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] No waiting events found dispatching network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:16:00 user nova-compute[72409]: WARNING nova.compute.manager [req-d3f9c9ae-f749-482b-b490-e05b693feff5 req-caeff3fb-e887-40d9-abd5-50c5769b2b89 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received unexpected event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 for instance with vm_state active and task_state rescuing.
Aug 09 23:16:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-fc54f737-964f-4332-9d4b-3ac356602771 req-fc4cab24-e51c-4a90-b8d9-f7f8ccffbc5f service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fc54f737-964f-4332-9d4b-3ac356602771 req-fc4cab24-e51c-4a90-b8d9-f7f8ccffbc5f service nova] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fc54f737-964f-4332-9d4b-3ac356602771 req-fc4cab24-e51c-4a90-b8d9-f7f8ccffbc5f service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fc54f737-964f-4332-9d4b-3ac356602771 req-fc4cab24-e51c-4a90-b8d9-f7f8ccffbc5f service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-fc54f737-964f-4332-9d4b-3ac356602771 req-fc4cab24-e51c-4a90-b8d9-f7f8ccffbc5f service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] No waiting events found dispatching network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:16:02 user nova-compute[72409]: WARNING nova.compute.manager [req-fc54f737-964f-4332-9d4b-3ac356602771 req-fc4cab24-e51c-4a90-b8d9-f7f8ccffbc5f service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received unexpected event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 for instance with vm_state active and task_state rescuing.
Aug 09 23:16:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-fc54f737-964f-4332-9d4b-3ac356602771 req-fc4cab24-e51c-4a90-b8d9-f7f8ccffbc5f service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fc54f737-964f-4332-9d4b-3ac356602771 req-fc4cab24-e51c-4a90-b8d9-f7f8ccffbc5f service nova] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fc54f737-964f-4332-9d4b-3ac356602771 req-fc4cab24-e51c-4a90-b8d9-f7f8ccffbc5f service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fc54f737-964f-4332-9d4b-3ac356602771 req-fc4cab24-e51c-4a90-b8d9-f7f8ccffbc5f service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG nova.compute.manager [req-fc54f737-964f-4332-9d4b-3ac356602771 req-fc4cab24-e51c-4a90-b8d9-f7f8ccffbc5f service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] No waiting events found dispatching network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:16:02 user nova-compute[72409]: WARNING nova.compute.manager [req-fc54f737-964f-4332-9d4b-3ac356602771 req-fc4cab24-e51c-4a90-b8d9-f7f8ccffbc5f service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received unexpected event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 for instance with vm_state active and task_state rescuing.
Aug 09 23:16:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Removed pending event for 76e542ee-fc49-430c-b2c3-2cd2913075a0 due to event {{(pid=72409) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622962.88264, 76e542ee-fc49-430c-b2c3-2cd2913075a0 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:16:02 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] VM Resumed (Lifecycle Event)
Aug 09 23:16:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-c0009c99-1f45-4866-ae43-98efa07049e7 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:16:02 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 23:16:02 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691622962.8865452, 76e542ee-fc49-430c-b2c3-2cd2913075a0 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:16:02 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] VM Started (Lifecycle Event)
Aug 09 23:16:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:16:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:16:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:07 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:07 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:08 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:08 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 23:16:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] There are 0 instances to clean {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 23:16:09 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:16:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:16:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:16:09 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:10 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:16:12 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:16:12 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8209MB free_disk=25.134387969970703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 76e542ee-fc49-430c-b2c3-2cd2913075a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing inventories for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating ProviderTree inventory for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing aggregate associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, aggregates: None {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 23:16:12 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing trait associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 23:16:13 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:16:13 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:16:13 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:16:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:16:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Updating instance_info_cache with network_info: [{"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:16:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:28 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:16:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:16:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:16:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:16:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:16:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:16:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:16:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:16:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:16:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid a074c83c-2e90-4675-89dc-4006294cfdee {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 5a24033f-5bf1-4747-a8f4-3edc32600a9a {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "a074c83c-2e90-4675-89dc-4006294cfdee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "a074c83c-2e90-4675-89dc-4006294cfdee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:16:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:16:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:16:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:16:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:16:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:16:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:16:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:16:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:17:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:08 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:17:08 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:17:11 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:17:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:17:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:17:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:17:11 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:17:14 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:17:14 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8325MB free_disk=25.125350952148438GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 76e542ee-fc49-430c-b2c3-2cd2913075a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:17:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:17:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:17:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:17:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:17:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:17:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:17:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:17:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:17:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:17:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:17:18 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:17:19 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Updating instance_info_cache with network_info: [{"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:17:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:17:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:17:19 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:17:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:17:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-05020de5-38c0-448c-a21c-3fe16c26498b req-1e1f2a91-4bb2-45de-af16-ce99c7c0727e service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Received event network-changed-24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:17:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-05020de5-38c0-448c-a21c-3fe16c26498b req-1e1f2a91-4bb2-45de-af16-ce99c7c0727e service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Refreshing instance network info cache due to event network-changed-24e18d51-d819-4195-a1a9-12555bb6a648. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:17:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05020de5-38c0-448c-a21c-3fe16c26498b req-1e1f2a91-4bb2-45de-af16-ce99c7c0727e service nova] Acquiring lock "refresh_cache-7d1268b0-db1f-4974-a6ba-ac9c4189adb7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:17:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05020de5-38c0-448c-a21c-3fe16c26498b req-1e1f2a91-4bb2-45de-af16-ce99c7c0727e service nova] Acquired lock "refresh_cache-7d1268b0-db1f-4974-a6ba-ac9c4189adb7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:17:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-05020de5-38c0-448c-a21c-3fe16c26498b req-1e1f2a91-4bb2-45de-af16-ce99c7c0727e service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Refreshing network info cache for port 24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:17:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-05020de5-38c0-448c-a21c-3fe16c26498b req-1e1f2a91-4bb2-45de-af16-ce99c7c0727e service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Updated VIF entry in instance network info cache for port 24e18d51-d819-4195-a1a9-12555bb6a648. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:17:30 user nova-compute[72409]: DEBUG nova.network.neutron [req-05020de5-38c0-448c-a21c-3fe16c26498b req-1e1f2a91-4bb2-45de-af16-ce99c7c0727e service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Updating instance_info_cache with network_info: [{"id": "24e18d51-d819-4195-a1a9-12555bb6a648", "address": "fa:16:3e:4a:ba:90", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e18d51-d8", "ovs_interfaceid": "24e18d51-d819-4195-a1a9-12555bb6a648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:17:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-05020de5-38c0-448c-a21c-3fe16c26498b req-1e1f2a91-4bb2-45de-af16-ce99c7c0727e service nova] Releasing lock "refresh_cache-7d1268b0-db1f-4974-a6ba-ac9c4189adb7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:17:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:17:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:17:31 user nova-compute[72409]: DEBUG nova.objects.instance [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lazy-loading 'flavor' on Instance uuid 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:17:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.046s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:17:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:17:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:17:31 user nova-compute[72409]: INFO nova.compute.manager [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Attaching volume edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 to /dev/vdb
Aug 09 23:17:31 user nova-compute[72409]: DEBUG os_brick.utils [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:17:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7e7089-e9e7-4407-a987-b91db1bc0244]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cdfb56-553d-4bed-8da3-9a46cd47a2cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd086921-c90e-47cc-9b11-e9487493d9f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73bc7c-cabd-4568-ae86-3c41e2d13cf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:17:32 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:17:32 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d0cf73-146b-42e3-9c69-cc0b30f47b53]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG os_brick.utils [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Updating existing volume attachment record: 11053f5e-3d65-4b1c-a722-d6cb1c48e554 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:33 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:17:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:17:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquired lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:17:33 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:17:33 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'info_cache' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updating instance_info_cache with network_info: [{"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Releasing lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:17:34 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance destroyed successfully.
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'resources' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-158408380',display_name='tempest-AttachVolumeTestJSON-server-158408380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-158408380',id=43,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7cyVxAqMw/gmzCUNmkaDKLkx5O4eZ4SJ14bCtziFqZelGzHQrhavYLL+rKID1RcDRMeRuc/KiuUItVmoh138Xg+EqTD2HksOySvGeMflViOS+DxVsxR1mjmffB7SuBiA==',key_name='tempest-keypair-867359187',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:13:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5148973bc704627aeccf788e9ac4412',ramdisk_id='',reservation_id='r-hclxvq1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885013657',owner_user_name='tempest-AttachVolumeTestJSON-1885013657-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='404739e50bd042d29d060fb39c1f8c4a',uuid=c43b9b78-3237-4cb0-be8a-0b3ec6e53aba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converting VIF {"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_vif [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap051b3c51-48, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:17:34 user nova-compute[72409]: INFO os_vif [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48')
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcsaMGmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:17:34 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32ee1f0-37da-4d0e-bca7-73b447659389]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e90b5a-83d6-4196-8831-3ed0ddb9ea06]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:17:34 user nova-compute[72409]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:17:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:17:34 user nova-compute[72409]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:17:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84435ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad5c572-ec92-4345-9a5d-ba6c11c72976]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[697d5427-4a67-4b93-8213-8a5563102486]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ee04a7-dede-4459-bf3f-c712f05c7f63]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dc7d2e-8e18-4bbf-9925-0528d401682f]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22f014d-8ec5-4502-857b-5c0fae794614]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbe0c39-33aa-48ff-92df-7c9e42194c55]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260]
Aug 09 23:17:34 user nova-compute[72409]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260] successful.
Aug 09 23:17:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e3d1f7-222a-4b5d-aae3-2957a44eefdc]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] <== disconnect_volume: return (267ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Start _get_guest_xml network_info=[{"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcsaMGmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c43b9b78-3237-4cb0-be8a-0b3ec6e53aba', 'attached_at': '', 'detached_at': '', 'volume_id': '898c2d38-0af8-48cb-88f1-b66fcb4d1890', 'serial': '898c2d38-0af8-48cb-88f1-b66fcb4d1890'}, 'mount_device': '/dev/vdb', 'attachment_id': '1dd5272e-63c7-46d5-879e-2cda429efb4b', 'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'numa_topology' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:17:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:17:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'vcpu_model' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcsaMGmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:17:34 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:17:34 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:17:34 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cdff27-bbb5-46c9-9ae9-246966283d5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:17:34 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd91e88-c0cb-4340-816c-afff16f1f470]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890] added
Aug 09 23:17:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c79974c-c386-49e0-8f54-f464e4ba97b0]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e29bdc2-f001-4a38-8a0c-366e25ca2ee2]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcsaMGmu {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcsaMGmu" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[045cd774-58ed-4ca5-a0b2-c15193f1ce5a]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcsaMGmu'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2371c72-8503-4bdd-85b2-75b5b9d36c22]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4b30a3-0bbc-409f-9b75-70399e95c1fe]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:17:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:17:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85f0b43-e966-4525-a8d9-c8418698d1d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260]
Aug 09 23:17:35 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260] successful.
Aug 09 23:17:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7afab8-7a07-4db8-9610-5d12386c8ccf]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3df7c7-ed8b-4225-98d7-b58d534264a2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:17:35 user nova-compute[72409]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:17:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:17:35 user nova-compute[72409]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:17:35 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d1d8c5-91af-4df1-a13b-0b2d3620e674]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:17:35 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcsaMGmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23962306462363464', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962306462363464', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-158408380',display_name='tempest-AttachVolumeTestJSON-server-158408380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-158408380',id=43,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7cyVxAqMw/gmzCUNmkaDKLkx5O4eZ4SJ14bCtziFqZelGzHQrhavYLL+rKID1RcDRMeRuc/KiuUItVmoh138Xg+EqTD2HksOySvGeMflViOS+DxVsxR1mjmffB7SuBiA==',key_name='tempest-keypair-867359187',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:13:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5148973bc704627aeccf788e9ac4412',ramdisk_id='',reservation_id='r-hclxvq1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885013657',owner_user_name='tempest-AttachVolumeTestJSON-1885013657-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='404739e50bd042d29d060fb39c1f8c4a',uuid=c43b9b78-3237-4cb0-be8a-0b3ec6e53aba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converting VIF {"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'pci_devices' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:17:36 user nova-compute[72409]:   <uuid>c43b9b78-3237-4cb0-be8a-0b3ec6e53aba</uuid>
Aug 09 23:17:36 user nova-compute[72409]:   <name>instance-0000002b</name>
Aug 09 23:17:36 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:17:36 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:17:36 user nova-compute[72409]:   <metadata>
Aug 09 23:17:36 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:17:36 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:17:36 user nova-compute[72409]:       <nova:name>tempest-AttachVolumeTestJSON-server-158408380</nova:name>
Aug 09 23:17:36 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:17:34</nova:creationTime>
Aug 09 23:17:36 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:17:36 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:17:36 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:17:36 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:17:36 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:17:36 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:17:36 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:17:36 user nova-compute[72409]:       <nova:owner>
Aug 09 23:17:36 user nova-compute[72409]:         <nova:user uuid="404739e50bd042d29d060fb39c1f8c4a">tempest-AttachVolumeTestJSON-1885013657-project-member</nova:user>
Aug 09 23:17:36 user nova-compute[72409]:         <nova:project uuid="b5148973bc704627aeccf788e9ac4412">tempest-AttachVolumeTestJSON-1885013657</nova:project>
Aug 09 23:17:36 user nova-compute[72409]:       </nova:owner>
Aug 09 23:17:36 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:17:36 user nova-compute[72409]:       <nova:ports>
Aug 09 23:17:36 user nova-compute[72409]:         <nova:port uuid="051b3c51-4821-4807-b65f-f5fe5894509c">
Aug 09 23:17:36 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 23:17:36 user nova-compute[72409]:         </nova:port>
Aug 09 23:17:36 user nova-compute[72409]:       </nova:ports>
Aug 09 23:17:36 user nova-compute[72409]:     </nova:instance>
Aug 09 23:17:36 user nova-compute[72409]:   </metadata>
Aug 09 23:17:36 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:17:36 user nova-compute[72409]:     <system>
Aug 09 23:17:36 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:17:36 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:17:36 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:17:36 user nova-compute[72409]:       <entry name="serial">c43b9b78-3237-4cb0-be8a-0b3ec6e53aba</entry>
Aug 09 23:17:36 user nova-compute[72409]:       <entry name="uuid">c43b9b78-3237-4cb0-be8a-0b3ec6e53aba</entry>
Aug 09 23:17:36 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:17:36 user nova-compute[72409]:     </system>
Aug 09 23:17:36 user nova-compute[72409]:   </sysinfo>
Aug 09 23:17:36 user nova-compute[72409]:   <os>
Aug 09 23:17:36 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:17:36 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:17:36 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:17:36 user nova-compute[72409]:   </os>
Aug 09 23:17:36 user nova-compute[72409]:   <features>
Aug 09 23:17:36 user nova-compute[72409]:     <acpi/>
Aug 09 23:17:36 user nova-compute[72409]:     <apic/>
Aug 09 23:17:36 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:17:36 user nova-compute[72409]:   </features>
Aug 09 23:17:36 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:17:36 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:17:36 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:17:36 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:17:36 user nova-compute[72409]:   </clock>
Aug 09 23:17:36 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:17:36 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:17:36 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:17:36 user nova-compute[72409]:   </cpu>
Aug 09 23:17:36 user nova-compute[72409]:   <devices>
Aug 09 23:17:36 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:17:36 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:17:36 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk"/>
Aug 09 23:17:36 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:17:36 user nova-compute[72409]:     </disk>
Aug 09 23:17:36 user nova-compute[72409]:     <disk type="block" device="disk">
Aug 09 23:17:36 user nova-compute[72409]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:17:36 user nova-compute[72409]:       <source dev="/dev/sdb"/>
Aug 09 23:17:36 user nova-compute[72409]:       <target dev="vdb" bus="virtio"/>
Aug 09 23:17:36 user nova-compute[72409]:       <serial>898c2d38-0af8-48cb-88f1-b66fcb4d1890</serial>
Aug 09 23:17:36 user nova-compute[72409]:     </disk>
Aug 09 23:17:36 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:17:36 user nova-compute[72409]:       <mac address="fa:16:3e:19:e9:13"/>
Aug 09 23:17:36 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:17:36 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:17:36 user nova-compute[72409]:       <target dev="tap051b3c51-48"/>
Aug 09 23:17:36 user nova-compute[72409]:     </interface>
Aug 09 23:17:36 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:17:36 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/console.log" append="off"/>
Aug 09 23:17:36 user nova-compute[72409]:     </serial>
Aug 09 23:17:36 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:17:36 user nova-compute[72409]:     <video>
Aug 09 23:17:36 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:17:36 user nova-compute[72409]:     </video>
Aug 09 23:17:36 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:17:36 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:17:36 user nova-compute[72409]:     </rng>
Aug 09 23:17:36 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:17:36 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:17:36 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:17:36 user nova-compute[72409]:     </memballoon>
Aug 09 23:17:36 user nova-compute[72409]:   </devices>
Aug 09 23:17:36 user nova-compute[72409]: </domain>
Aug 09 23:17:36 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'trusted_certs' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.129s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Cannot resize image /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'migration_context' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-158408380',display_name='tempest-AttachVolumeTestJSON-server-158408380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-158408380',id=43,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7cyVxAqMw/gmzCUNmkaDKLkx5O4eZ4SJ14bCtziFqZelGzHQrhavYLL+rKID1RcDRMeRuc/KiuUItVmoh138Xg+EqTD2HksOySvGeMflViOS+DxVsxR1mjmffB7SuBiA==',key_name='tempest-keypair-867359187',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:13:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b5148973bc704627aeccf788e9ac4412',ramdisk_id='',reservation_id='r-hclxvq1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885013657',owner_user_name='tempest-AttachVolumeTestJSON-1885013657-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='404739e50bd042d29d060fb39c1f8c4a',uuid=c43b9b78-3237-4cb0-be8a-0b3ec6e53aba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converting VIF {"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG os_vif [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap051b3c51-48, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap051b3c51-48, col_values=(('external_ids', {'iface-id': '051b3c51-4821-4807-b65f-f5fe5894509c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:e9:13', 'vm-uuid': 'c43b9b78-3237-4cb0-be8a-0b3ec6e53aba'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:17:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:36 user nova-compute[72409]: INFO os_vif [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48')
Aug 09 23:17:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-1769984b-f807-41d7-8401-9aa89b40cc73 req-04a40e8e-da1f-441c-9e36-5fe2fdd292eb service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:17:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1769984b-f807-41d7-8401-9aa89b40cc73 req-04a40e8e-da1f-441c-9e36-5fe2fdd292eb service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:17:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1769984b-f807-41d7-8401-9aa89b40cc73 req-04a40e8e-da1f-441c-9e36-5fe2fdd292eb service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:17:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1769984b-f807-41d7-8401-9aa89b40cc73 req-04a40e8e-da1f-441c-9e36-5fe2fdd292eb service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:17:38 user nova-compute[72409]: DEBUG nova.compute.manager [req-1769984b-f807-41d7-8401-9aa89b40cc73 req-04a40e8e-da1f-441c-9e36-5fe2fdd292eb service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:17:38 user nova-compute[72409]: WARNING nova.compute.manager [req-1769984b-f807-41d7-8401-9aa89b40cc73 req-04a40e8e-da1f-441c-9e36-5fe2fdd292eb service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state stopped and task_state powering-on.
Aug 09 23:17:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623060.3390694, c43b9b78-3237-4cb0-be8a-0b3ec6e53aba => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:17:40 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] VM Resumed (Lifecycle Event)
Aug 09 23:17:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:17:40 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance rebooted successfully.
Aug 09 23:17:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2f61f22f-86c4-4685-9507-e3fee07b9f02 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:17:40 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 23:17:40 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623060.3404424, c43b9b78-3237-4cb0-be8a-0b3ec6e53aba => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:17:40 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] VM Started (Lifecycle Event)
Aug 09 23:17:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfQwzEGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:17:40 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:17:40 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:17:40 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d76ebc-1216-4988-88cc-9c56740a9776]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:17:40 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG nova.compute.manager [req-dc762de9-9825-45cf-bc1a-54a9223699d5 req-789fa925-a9c2-445e-bacd-450bd032942e service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dc762de9-9825-45cf-bc1a-54a9223699d5 req-789fa925-a9c2-445e-bacd-450bd032942e service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dc762de9-9825-45cf-bc1a-54a9223699d5 req-789fa925-a9c2-445e-bacd-450bd032942e service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dc762de9-9825-45cf-bc1a-54a9223699d5 req-789fa925-a9c2-445e-bacd-450bd032942e service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG nova.compute.manager [req-dc762de9-9825-45cf-bc1a-54a9223699d5 req-789fa925-a9c2-445e-bacd-450bd032942e service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:17:40 user nova-compute[72409]: WARNING nova.compute.manager [req-dc762de9-9825-45cf-bc1a-54a9223699d5 req-789fa925-a9c2-445e-bacd-450bd032942e service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state active and task_state None.
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[108d5f6e-8d16-4a85-a42a-bd08d48ee056]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21] added
Aug 09 23:17:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[76680091-c6da-46b4-abac-5184163b7487]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e718bce-4757-40f3-9e7f-7962788ffc08]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mfQwzEGW {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mfQwzEGW" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33c9626-6066-45d4-9cd2-007f0805b8b7]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mfQwzEGW'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52a0b3e-ae57-485c-82c2-6d1b6f0dae2a]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c38df5-7555-4c26-81be-d92c0aa102f9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:17:40 user nova-compute[72409]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:17:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:17:40 user nova-compute[72409]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:17:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f799b16a-0cf5-4819-97df-99cbda13e5ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21, portal: 172.16.0.220,3260]
Aug 09 23:17:40 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21, portal: 172.16.0.220,3260] successful.
Aug 09 23:17:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e69966-6bfa-467e-9ee1-f45974d5acc5]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a97a66-20e3-402d-9b8c-0db68c7a2a12]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:17:40 user nova-compute[72409]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:17:40 user nova-compute[72409]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 (non-flash)
Aug 09 23:17:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:17:40 user nova-compute[72409]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:17:40 user nova-compute[72409]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 (non-flash)
Aug 09 23:17:40 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbf6d8d-4759-4468-b3c0-8421abda42c0]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:17:40 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfQwzEGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:17:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:17:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23839343762656162', 'path': '/dev/sdd'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:17:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839343762656162', 'path': '/dev/sdd'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:17:41 user nova-compute[72409]: DEBUG nova.objects.instance [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lazy-loading 'flavor' on Instance uuid 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:17:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:17:41 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:17:41 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 23:17:41 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:17:41 user nova-compute[72409]:   <serial>edbcb5b4-478b-495e-a5f0-b0d55f3b5f21</serial>
Aug 09 23:17:41 user nova-compute[72409]: </disk>
Aug 09 23:17:41 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:17:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:17:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:17:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] No VIF found with MAC fa:16:3e:4a:ba:90, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:17:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-64121161-47b2-40bb-bb11-3799201bd6d0 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.486s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:17:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:17:43 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:17:43 user nova-compute[72409]: INFO nova.compute.manager [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Detaching volume edbcb5b4-478b-495e-a5f0-b0d55f3b5f21
Aug 09 23:17:44 user nova-compute[72409]: INFO nova.virt.block_device [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Attempting to driver detach volume edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 from mountpoint /dev/vdb
Aug 09 23:17:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Attempting to detach device vdb from instance 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:17:44 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:17:44 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 23:17:44 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:17:44 user nova-compute[72409]:   <serial>edbcb5b4-478b-495e-a5f0-b0d55f3b5f21</serial>
Aug 09 23:17:44 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:17:44 user nova-compute[72409]: </disk>
Aug 09 23:17:44 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:17:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Successfully detached device vdb from instance 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 from the persistent domain config.
Aug 09 23:17:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:17:44 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:17:44 user nova-compute[72409]:   <source dev="/dev/sdd"/>
Aug 09 23:17:44 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:17:44 user nova-compute[72409]:   <serial>edbcb5b4-478b-495e-a5f0-b0d55f3b5f21</serial>
Aug 09 23:17:44 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:17:44 user nova-compute[72409]: </disk>
Aug 09 23:17:44 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691623064.5501494, 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:17:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Successfully detached device vdb from instance 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 from the live domain config.
Aug 09 23:17:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mfQwzEGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:17:44 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[16390eef-1c67-453b-9d82-18aea809e901]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8b4a7b-bcc8-44c4-b6d8-e4cf38183685]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:17:44 user nova-compute[72409]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:17:44 user nova-compute[72409]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 (non-flash)
Aug 09 23:17:44 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:17:44 user nova-compute[72409]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:17:44 user nova-compute[72409]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 (non-flash)
Aug 09 23:17:44 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84299990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21'): ({'sdd'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Removing single pathed devices sdd {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[385644df-f9c5-4f54-b387-91b197ee30fb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4f6478-2e37-4e45-b4d3-7d2f586fcb81]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Flushing IO for device /dev/sdd {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac1f4e4-bacf-40d2-9f51-e38672a5d971]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccc8c9c-71b4-43b7-be88-77fe0de1febb]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] SCSI volumes sdd have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb24957-ae84-4acb-99ee-a80035035f16]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a973d13e-b8c6-4e76-9cef-0da7130388df]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21, portal: 172.16.0.220,3260]
Aug 09 23:17:44 user nova-compute[72409]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21, portal: 172.16.0.220,3260] successful.
Aug 09 23:17:44 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edbcb5b4-478b-495e-a5f0-b0d55f3b5f21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe33c4d-3fcf-4225-bc5d-fd79dbddcc52]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] <== disconnect_volume: return (290ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:17:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:17:45 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lazy-loading 'flavor' on Instance uuid 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:17:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b3845ab6-7e06-4758-821a-c2c732369fa1 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.701s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:17:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:48 user nova-compute[72409]: INFO nova.compute.manager [None req-6707b5b3-a918-4e70-865a-5d9ec228b502 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Unrescuing
Aug 09 23:17:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6707b5b3-a918-4e70-865a-5d9ec228b502 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:17:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6707b5b3-a918-4e70-865a-5d9ec228b502 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquired lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:17:48 user nova-compute[72409]: DEBUG nova.network.neutron [None req-6707b5b3-a918-4e70-865a-5d9ec228b502 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:17:49 user nova-compute[72409]: DEBUG nova.network.neutron [None req-6707b5b3-a918-4e70-865a-5d9ec228b502 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updating instance_info_cache with network_info: [{"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:17:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-6707b5b3-a918-4e70-865a-5d9ec228b502 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Releasing lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:17:49 user nova-compute[72409]: DEBUG nova.objects.instance [None req-6707b5b3-a918-4e70-865a-5d9ec228b502 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'flavor' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:17:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-696f773b-5512-432d-b6f4-276e7327775e req-4f6cc851-1beb-41e6-a2c5-7723c94f286a service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-unplugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:17:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-696f773b-5512-432d-b6f4-276e7327775e req-4f6cc851-1beb-41e6-a2c5-7723c94f286a service nova] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:17:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-696f773b-5512-432d-b6f4-276e7327775e req-4f6cc851-1beb-41e6-a2c5-7723c94f286a service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:17:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-696f773b-5512-432d-b6f4-276e7327775e req-4f6cc851-1beb-41e6-a2c5-7723c94f286a service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:17:49 user nova-compute[72409]: DEBUG nova.compute.manager [req-696f773b-5512-432d-b6f4-276e7327775e req-4f6cc851-1beb-41e6-a2c5-7723c94f286a service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] No waiting events found dispatching network-vif-unplugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:17:49 user nova-compute[72409]: WARNING nova.compute.manager [req-696f773b-5512-432d-b6f4-276e7327775e req-4f6cc851-1beb-41e6-a2c5-7723c94f286a service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received unexpected event network-vif-unplugged-d115dd28-4650-4494-8fb0-d387a77b1600 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:17:49 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Instance destroyed successfully.
Aug 09 23:17:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-b8dbfede-1f22-47da-9c70-527dc276109a req-082d6e36-4fb5-41ce-b7db-42aee21f1398 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:17:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b8dbfede-1f22-47da-9c70-527dc276109a req-082d6e36-4fb5-41ce-b7db-42aee21f1398 service nova] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:17:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b8dbfede-1f22-47da-9c70-527dc276109a req-082d6e36-4fb5-41ce-b7db-42aee21f1398 service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:17:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b8dbfede-1f22-47da-9c70-527dc276109a req-082d6e36-4fb5-41ce-b7db-42aee21f1398 service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:17:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-b8dbfede-1f22-47da-9c70-527dc276109a req-082d6e36-4fb5-41ce-b7db-42aee21f1398 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] No waiting events found dispatching network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:17:51 user nova-compute[72409]: WARNING nova.compute.manager [req-b8dbfede-1f22-47da-9c70-527dc276109a req-082d6e36-4fb5-41ce-b7db-42aee21f1398 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received unexpected event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:17:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-b8dbfede-1f22-47da-9c70-527dc276109a req-082d6e36-4fb5-41ce-b7db-42aee21f1398 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:17:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b8dbfede-1f22-47da-9c70-527dc276109a req-082d6e36-4fb5-41ce-b7db-42aee21f1398 service nova] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:17:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b8dbfede-1f22-47da-9c70-527dc276109a req-082d6e36-4fb5-41ce-b7db-42aee21f1398 service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:17:51 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b8dbfede-1f22-47da-9c70-527dc276109a req-082d6e36-4fb5-41ce-b7db-42aee21f1398 service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:17:51 user nova-compute[72409]: DEBUG nova.compute.manager [req-b8dbfede-1f22-47da-9c70-527dc276109a req-082d6e36-4fb5-41ce-b7db-42aee21f1398 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] No waiting events found dispatching network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:17:51 user nova-compute[72409]: WARNING nova.compute.manager [req-b8dbfede-1f22-47da-9c70-527dc276109a req-082d6e36-4fb5-41ce-b7db-42aee21f1398 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received unexpected event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 for instance with vm_state rescued and task_state unrescuing.
Aug 09 23:17:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:53 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Removed pending event for 76e542ee-fc49-430c-b2c3-2cd2913075a0 due to event {{(pid=72409) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 23:17:53 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623073.203683, 76e542ee-fc49-430c-b2c3-2cd2913075a0 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:17:53 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] VM Resumed (Lifecycle Event)
Aug 09 23:17:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-6707b5b3-a918-4e70-865a-5d9ec228b502 tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:17:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:17:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:17:53 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 23:17:53 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623073.2047403, 76e542ee-fc49-430c-b2c3-2cd2913075a0 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:17:53 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] VM Started (Lifecycle Event)
Aug 09 23:17:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:17:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:17:53 user nova-compute[72409]: DEBUG nova.compute.manager [req-66bc2653-2719-4147-8bf4-16f9ab819ccd req-bccefb62-1475-449e-80f5-19a78d6feacc service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:17:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-66bc2653-2719-4147-8bf4-16f9ab819ccd req-bccefb62-1475-449e-80f5-19a78d6feacc service nova] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:17:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-66bc2653-2719-4147-8bf4-16f9ab819ccd req-bccefb62-1475-449e-80f5-19a78d6feacc service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:17:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-66bc2653-2719-4147-8bf4-16f9ab819ccd req-bccefb62-1475-449e-80f5-19a78d6feacc service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:17:53 user nova-compute[72409]: DEBUG nova.compute.manager [req-66bc2653-2719-4147-8bf4-16f9ab819ccd req-bccefb62-1475-449e-80f5-19a78d6feacc service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] No waiting events found dispatching network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:17:53 user nova-compute[72409]: WARNING nova.compute.manager [req-66bc2653-2719-4147-8bf4-16f9ab819ccd req-bccefb62-1475-449e-80f5-19a78d6feacc service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received unexpected event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 for instance with vm_state active and task_state None.
Aug 09 23:17:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:17:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:11 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:18:11 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:18:11 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:18:11 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:18:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:18:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:18:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:18:11 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:18:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:11 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:18:14 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:18:14 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8159MB free_disk=25.122814178466797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 76e542ee-fc49-430c-b2c3-2cd2913075a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:18:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:18:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:18:18 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:18:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:18:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:18:18 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:18:20 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updating instance_info_cache with network_info: [{"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:18:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:18:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:18:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:18:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:18:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:18:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:18:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:18:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:18:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:18:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:18:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:18:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:18:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:34 user nova-compute[72409]: DEBUG nova.compute.manager [req-7c88fbb7-a391-419e-9c6a-3e632b25c28b req-247f5b97-1445-4fb4-8367-6f8ab9e67e0a service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Received event network-changed-24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:18:34 user nova-compute[72409]: DEBUG nova.compute.manager [req-7c88fbb7-a391-419e-9c6a-3e632b25c28b req-247f5b97-1445-4fb4-8367-6f8ab9e67e0a service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Refreshing instance network info cache due to event network-changed-24e18d51-d819-4195-a1a9-12555bb6a648. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:18:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7c88fbb7-a391-419e-9c6a-3e632b25c28b req-247f5b97-1445-4fb4-8367-6f8ab9e67e0a service nova] Acquiring lock "refresh_cache-7d1268b0-db1f-4974-a6ba-ac9c4189adb7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:18:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7c88fbb7-a391-419e-9c6a-3e632b25c28b req-247f5b97-1445-4fb4-8367-6f8ab9e67e0a service nova] Acquired lock "refresh_cache-7d1268b0-db1f-4974-a6ba-ac9c4189adb7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:18:34 user nova-compute[72409]: DEBUG nova.network.neutron [req-7c88fbb7-a391-419e-9c6a-3e632b25c28b req-247f5b97-1445-4fb4-8367-6f8ab9e67e0a service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Refreshing network info cache for port 24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:18:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:18:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:18:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:18:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:18:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:18:34 user nova-compute[72409]: INFO nova.compute.manager [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Terminating instance
Aug 09 23:18:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-ba4e8b25-9a34-4b9d-98b9-87e393bea6ca req-275954f9-26e3-4dc0-8819-f0ff8fb2cbc6 service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Received event network-vif-unplugged-24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ba4e8b25-9a34-4b9d-98b9-87e393bea6ca req-275954f9-26e3-4dc0-8819-f0ff8fb2cbc6 service nova] Acquiring lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ba4e8b25-9a34-4b9d-98b9-87e393bea6ca req-275954f9-26e3-4dc0-8819-f0ff8fb2cbc6 service nova] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ba4e8b25-9a34-4b9d-98b9-87e393bea6ca req-275954f9-26e3-4dc0-8819-f0ff8fb2cbc6 service nova] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-ba4e8b25-9a34-4b9d-98b9-87e393bea6ca req-275954f9-26e3-4dc0-8819-f0ff8fb2cbc6 service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] No waiting events found dispatching network-vif-unplugged-24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-ba4e8b25-9a34-4b9d-98b9-87e393bea6ca req-275954f9-26e3-4dc0-8819-f0ff8fb2cbc6 service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Received event network-vif-unplugged-24e18d51-d819-4195-a1a9-12555bb6a648 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG nova.network.neutron [req-7c88fbb7-a391-419e-9c6a-3e632b25c28b req-247f5b97-1445-4fb4-8367-6f8ab9e67e0a service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Updated VIF entry in instance network info cache for port 24e18d51-d819-4195-a1a9-12555bb6a648. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG nova.network.neutron [req-7c88fbb7-a391-419e-9c6a-3e632b25c28b req-247f5b97-1445-4fb4-8367-6f8ab9e67e0a service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Updating instance_info_cache with network_info: [{"id": "24e18d51-d819-4195-a1a9-12555bb6a648", "address": "fa:16:3e:4a:ba:90", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e18d51-d8", "ovs_interfaceid": "24e18d51-d819-4195-a1a9-12555bb6a648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-7c88fbb7-a391-419e-9c6a-3e632b25c28b req-247f5b97-1445-4fb4-8367-6f8ab9e67e0a service nova] Releasing lock "refresh_cache-7d1268b0-db1f-4974-a6ba-ac9c4189adb7" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Instance destroyed successfully.
Aug 09 23:18:35 user nova-compute[72409]: DEBUG nova.objects.instance [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lazy-loading 'resources' on Instance uuid 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1113876708',display_name='tempest-TestStampPattern-server-1113876708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1113876708',id=45,image_ref='a8eaf0c5-96e5-4a39-b520-67e61bf59271',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACqTN5JNJboA9fuy5/UTb+uTv5M7CNRxzTTBTq5qMrCSjkVTX26zZ8ycWZWQgsh8TUujt/vkEhg0GyHg4LEyMi1LYTUUsuY0vv4GJj3S4KwV8eNTp0vV4370y1nJlwPHw==',key_name='tempest-TestStampPattern-1134071202',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:15:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b705695877154faabd0c75185ad73491',ramdisk_id='',reservation_id='r-yx7vrlx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5a24033f-5bf1-4747-a8f4-3edc32600a9a',image_min_disk='1',image_min_ram='0',image_owner_id='b705695877154faabd0c75185ad73491',image_owner_project_name='tempest-TestStampPattern-322079569',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-322079569-project-member',image_user_id='4b61d55e8ee64a29932fdd5e96a1da9a',owner_project_name='tempest-TestStampPattern-322079569',owner_user_name='tempest-TestStampPattern-322079569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:15:46Z,user_data=None,user_id='4b61d55e8ee64a29932fdd5e96a1da9a',uuid=7d1268b0-db1f-4974-a6ba-ac9c4189adb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24e18d51-d819-4195-a1a9-12555bb6a648", "address": "fa:16:3e:4a:ba:90", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e18d51-d8", "ovs_interfaceid": "24e18d51-d819-4195-a1a9-12555bb6a648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Converting VIF {"id": "24e18d51-d819-4195-a1a9-12555bb6a648", "address": "fa:16:3e:4a:ba:90", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e18d51-d8", "ovs_interfaceid": "24e18d51-d819-4195-a1a9-12555bb6a648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ba:90,bridge_name='br-int',has_traffic_filtering=True,id=24e18d51-d819-4195-a1a9-12555bb6a648,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e18d51-d8') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG os_vif [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ba:90,bridge_name='br-int',has_traffic_filtering=True,id=24e18d51-d819-4195-a1a9-12555bb6a648,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e18d51-d8') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24e18d51-d8, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:18:35 user nova-compute[72409]: INFO os_vif [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ba:90,bridge_name='br-int',has_traffic_filtering=True,id=24e18d51-d819-4195-a1a9-12555bb6a648,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e18d51-d8')
Aug 09 23:18:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Deleting instance files /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7_del
Aug 09 23:18:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Deletion of /opt/stack/data/nova/instances/7d1268b0-db1f-4974-a6ba-ac9c4189adb7_del complete
Aug 09 23:18:35 user nova-compute[72409]: INFO nova.compute.manager [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 09 23:18:35 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:18:35 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:18:36 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:18:36 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Took 0.44 seconds to deallocate network for instance.
Aug 09 23:18:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:18:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:18:36 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:18:36 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:18:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:18:36 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Deleted allocations for instance 7d1268b0-db1f-4974-a6ba-ac9c4189adb7
Aug 09 23:18:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-69f5ca73-99ba-455e-b0b6-124c95ab03dc tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.718s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:18:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-4fe43409-7769-4008-8d96-c82b8cbbdd6f req-9033aa14-bc5e-4595-9463-e7676b3c5bcf service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Received event network-vif-deleted-24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:18:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-dfac9972-4b09-469e-a961-92e10c33b4a2 req-4536bc37-cdaa-4cb4-ba12-f98d2db161a5 service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Received event network-vif-plugged-24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:18:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dfac9972-4b09-469e-a961-92e10c33b4a2 req-4536bc37-cdaa-4cb4-ba12-f98d2db161a5 service nova] Acquiring lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:18:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dfac9972-4b09-469e-a961-92e10c33b4a2 req-4536bc37-cdaa-4cb4-ba12-f98d2db161a5 service nova] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:18:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dfac9972-4b09-469e-a961-92e10c33b4a2 req-4536bc37-cdaa-4cb4-ba12-f98d2db161a5 service nova] Lock "7d1268b0-db1f-4974-a6ba-ac9c4189adb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:18:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-dfac9972-4b09-469e-a961-92e10c33b4a2 req-4536bc37-cdaa-4cb4-ba12-f98d2db161a5 service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] No waiting events found dispatching network-vif-plugged-24e18d51-d819-4195-a1a9-12555bb6a648 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:18:37 user nova-compute[72409]: WARNING nova.compute.manager [req-dfac9972-4b09-469e-a961-92e10c33b4a2 req-4536bc37-cdaa-4cb4-ba12-f98d2db161a5 service nova] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Received unexpected event network-vif-plugged-24e18d51-d819-4195-a1a9-12555bb6a648 for instance with vm_state deleted and task_state None.
Aug 09 23:18:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:18:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:18:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:18:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:18:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:50 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691623115.71405, 7d1268b0-db1f-4974-a6ba-ac9c4189adb7 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:18:50 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] VM Stopped (Lifecycle Event)
Aug 09 23:18:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4d9d4a19-5668-4326-9fbe-f9545698649a None None] [instance: 7d1268b0-db1f-4974-a6ba-ac9c4189adb7] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:18:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:18:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:19:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:19:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:19:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:19:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:19:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:11 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:19:11 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:19:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:19:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:12 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:14 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:19:15 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:19:15 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:19:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8339MB free_disk=25.123268127441406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 76e542ee-fc49-430c-b2c3-2cd2913075a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:19:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:19:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:19:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:19:20 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:19:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:21 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updating instance_info_cache with network_info: [{"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:19:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:19:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:19:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:19:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:19:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:19:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:19:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:19:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:25 user nova-compute[72409]: INFO nova.compute.manager [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Detaching volume 898c2d38-0af8-48cb-88f1-b66fcb4d1890
Aug 09 23:19:25 user nova-compute[72409]: INFO nova.virt.block_device [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Attempting to driver detach volume 898c2d38-0af8-48cb-88f1-b66fcb4d1890 from mountpoint /dev/vdb
Aug 09 23:19:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Attempting to detach device vdb from instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:19:25 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:19:25 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:19:25 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:19:25 user nova-compute[72409]:   <serial>898c2d38-0af8-48cb-88f1-b66fcb4d1890</serial>
Aug 09 23:19:25 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 23:19:25 user nova-compute[72409]: </disk>
Aug 09 23:19:25 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:19:25 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully detached device vdb from instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba from the persistent domain config.
Aug 09 23:19:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:19:25 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:19:25 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:19:25 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:19:25 user nova-compute[72409]:   <serial>898c2d38-0af8-48cb-88f1-b66fcb4d1890</serial>
Aug 09 23:19:25 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 23:19:25 user nova-compute[72409]: </disk>
Aug 09 23:19:25 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691623165.5149133, c43b9b78-3237-4cb0-be8a-0b3ec6e53aba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:19:25 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully detached device vdb from instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba from the live domain config.
Aug 09 23:19:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcsaMGmu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:19:25 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b1507e-6149-4619-96ad-c287237302b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c259915-1fa0-4d20-ad82-67899b791a3f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:19:25 user nova-compute[72409]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:19:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:19:25 user nova-compute[72409]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 (non-flash)
Aug 09 23:19:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84437ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3831f657-33f0-41e4-be13-0fc9c690de26]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aad58b-9cc9-46e7-8292-8d7067a6c600]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[047eb199-3a8f-4c9e-9fc0-c0e9578a758d]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[79168886-d2cb-413a-a30f-e4dfe7e890e9]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5594d8e8-8ca9-4012-b803-5a17532d3ce5]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30f5b24-df0d-46ec-92e5-1621a8e7b39f]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260]
Aug 09 23:19:25 user nova-compute[72409]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890, portal: 172.16.0.220,3260] successful.
Aug 09 23:19:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:898c2d38-0af8-48cb-88f1-b66fcb4d1890 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdd6e3b-f12f-4bf0-839e-2ee7c15aa010]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] <== disconnect_volume: return (271ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:19:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:19:26 user nova-compute[72409]: DEBUG nova.objects.instance [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:19:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-4e663802-16a0-4f29-bbd1-1819e61cb5b5 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.586s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-667ed5f7-cec8-4262-915a-ff7dc263fc2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-667ed5f7-cec8-4262-915a-ff7dc263fc2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-667ed5f7-cec8-4262-915a-ff7dc263fc2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-667ed5f7-cec8-4262-915a-ff7dc263fc2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72409) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG nova.objects.instance [None req-667ed5f7-cec8-4262-915a-ff7dc263fc2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-dd4f3d78-1977-47ed-892b-b3b812605e8a req-971a54eb-4244-4a34-811e-0da444081e62 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-unplugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dd4f3d78-1977-47ed-892b-b3b812605e8a req-971a54eb-4244-4a34-811e-0da444081e62 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dd4f3d78-1977-47ed-892b-b3b812605e8a req-971a54eb-4244-4a34-811e-0da444081e62 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dd4f3d78-1977-47ed-892b-b3b812605e8a req-971a54eb-4244-4a34-811e-0da444081e62 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-dd4f3d78-1977-47ed-892b-b3b812605e8a req-971a54eb-4244-4a34-811e-0da444081e62 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-unplugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:19:27 user nova-compute[72409]: WARNING nova.compute.manager [req-dd4f3d78-1977-47ed-892b-b3b812605e8a req-971a54eb-4244-4a34-811e-0da444081e62 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-unplugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state active and task_state powering-off.
Aug 09 23:19:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:28 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance destroyed successfully.
Aug 09 23:19:28 user nova-compute[72409]: DEBUG nova.compute.manager [None req-667ed5f7-cec8-4262-915a-ff7dc263fc2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:19:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-667ed5f7-cec8-4262-915a-ff7dc263fc2f tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.859s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:29 user nova-compute[72409]: DEBUG nova.compute.manager [req-847e4488-ff0a-40ee-bbb6-4f32991ec4b4 req-f50b6be9-bafe-4470-b010-07602137f405 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:19:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-847e4488-ff0a-40ee-bbb6-4f32991ec4b4 req-f50b6be9-bafe-4470-b010-07602137f405 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-847e4488-ff0a-40ee-bbb6-4f32991ec4b4 req-f50b6be9-bafe-4470-b010-07602137f405 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-847e4488-ff0a-40ee-bbb6-4f32991ec4b4 req-f50b6be9-bafe-4470-b010-07602137f405 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:29 user nova-compute[72409]: DEBUG nova.compute.manager [req-847e4488-ff0a-40ee-bbb6-4f32991ec4b4 req-f50b6be9-bafe-4470-b010-07602137f405 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:19:29 user nova-compute[72409]: WARNING nova.compute.manager [req-847e4488-ff0a-40ee-bbb6-4f32991ec4b4 req-f50b6be9-bafe-4470-b010-07602137f405 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state stopped and task_state None.
Aug 09 23:19:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-fe8afa5c-353e-4b9f-8bc7-881494dcf1bd req-1d243dcd-8d9b-4b9b-b758-95b2a771550e service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received event network-changed-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-fe8afa5c-353e-4b9f-8bc7-881494dcf1bd req-1d243dcd-8d9b-4b9b-b758-95b2a771550e service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Refreshing instance network info cache due to event network-changed-eb627aae-6309-48cb-8145-a9e530cc8d39. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fe8afa5c-353e-4b9f-8bc7-881494dcf1bd req-1d243dcd-8d9b-4b9b-b758-95b2a771550e service nova] Acquiring lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fe8afa5c-353e-4b9f-8bc7-881494dcf1bd req-1d243dcd-8d9b-4b9b-b758-95b2a771550e service nova] Acquired lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG nova.network.neutron [req-fe8afa5c-353e-4b9f-8bc7-881494dcf1bd req-1d243dcd-8d9b-4b9b-b758-95b2a771550e service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Refreshing network info cache for port eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:37 user nova-compute[72409]: INFO nova.compute.manager [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Terminating instance
Aug 09 23:19:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG nova.network.neutron [req-fe8afa5c-353e-4b9f-8bc7-881494dcf1bd req-1d243dcd-8d9b-4b9b-b758-95b2a771550e service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Updated VIF entry in instance network info cache for port eb627aae-6309-48cb-8145-a9e530cc8d39. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG nova.network.neutron [req-fe8afa5c-353e-4b9f-8bc7-881494dcf1bd req-1d243dcd-8d9b-4b9b-b758-95b2a771550e service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Updating instance_info_cache with network_info: [{"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:19:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-fe8afa5c-353e-4b9f-8bc7-881494dcf1bd req-1d243dcd-8d9b-4b9b-b758-95b2a771550e service nova] Releasing lock "refresh_cache-5a24033f-5bf1-4747-a8f4-3edc32600a9a" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Instance destroyed successfully.
Aug 09 23:19:38 user nova-compute[72409]: DEBUG nova.objects.instance [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lazy-loading 'resources' on Instance uuid 5a24033f-5bf1-4747-a8f4-3edc32600a9a {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1468976205',display_name='tempest-TestStampPattern-server-1468976205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1468976205',id=42,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACqTN5JNJboA9fuy5/UTb+uTv5M7CNRxzTTBTq5qMrCSjkVTX26zZ8ycWZWQgsh8TUujt/vkEhg0GyHg4LEyMi1LYTUUsuY0vv4GJj3S4KwV8eNTp0vV4370y1nJlwPHw==',key_name='tempest-TestStampPattern-1134071202',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:12:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b705695877154faabd0c75185ad73491',ramdisk_id='',reservation_id='r-0zrvv0a5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-322079569',owner_user_name='tempest-TestStampPattern-322079569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:15:37Z,user_data=None,user_id='4b61d55e8ee64a29932fdd5e96a1da9a',uuid=5a24033f-5bf1-4747-a8f4-3edc32600a9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Converting VIF {"id": "eb627aae-6309-48cb-8145-a9e530cc8d39", "address": "fa:16:3e:91:b5:d2", "network": {"id": "ea76d506-2204-43cd-8598-83e9be9a7ae0", "bridge": "br-int", "label": "tempest-TestStampPattern-405107396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b705695877154faabd0c75185ad73491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb627aae-63", "ovs_interfaceid": "eb627aae-6309-48cb-8145-a9e530cc8d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:b5:d2,bridge_name='br-int',has_traffic_filtering=True,id=eb627aae-6309-48cb-8145-a9e530cc8d39,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb627aae-63') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG os_vif [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:b5:d2,bridge_name='br-int',has_traffic_filtering=True,id=eb627aae-6309-48cb-8145-a9e530cc8d39,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb627aae-63') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb627aae-63, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:38 user nova-compute[72409]: INFO os_vif [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:b5:d2,bridge_name='br-int',has_traffic_filtering=True,id=eb627aae-6309-48cb-8145-a9e530cc8d39,network=Network(ea76d506-2204-43cd-8598-83e9be9a7ae0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb627aae-63')
Aug 09 23:19:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Deleting instance files /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a_del
Aug 09 23:19:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Deletion of /opt/stack/data/nova/instances/5a24033f-5bf1-4747-a8f4-3edc32600a9a_del complete
Aug 09 23:19:38 user nova-compute[72409]: INFO nova.compute.manager [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 23:19:38 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:19:39 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Took 0.86 seconds to deallocate network for instance.
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received event network-vif-unplugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] No waiting events found dispatching network-vif-unplugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:19:39 user nova-compute[72409]: WARNING nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received unexpected event network-vif-unplugged-eb627aae-6309-48cb-8145-a9e530cc8d39 for instance with vm_state deleted and task_state None.
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received event network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] No waiting events found dispatching network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:19:39 user nova-compute[72409]: WARNING nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received unexpected event network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 for instance with vm_state deleted and task_state None.
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received event network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] No waiting events found dispatching network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:19:39 user nova-compute[72409]: WARNING nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received unexpected event network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 for instance with vm_state deleted and task_state None.
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received event network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] No waiting events found dispatching network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:19:39 user nova-compute[72409]: WARNING nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received unexpected event network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 for instance with vm_state deleted and task_state None.
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received event network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Acquiring lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] No waiting events found dispatching network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:19:39 user nova-compute[72409]: WARNING nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received unexpected event network-vif-plugged-eb627aae-6309-48cb-8145-a9e530cc8d39 for instance with vm_state deleted and task_state None.
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-263a1396-d5ca-4f40-8924-a4feb334b27e req-38a6863a-dc6c-4508-a70e-615195135c2b service nova] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Received event network-vif-deleted-eb627aae-6309-48cb-8145-a9e530cc8d39 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:39 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Deleted allocations for instance 5a24033f-5bf1-4747-a8f4-3edc32600a9a
Aug 09 23:19:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-15cb92a5-1949-4b82-b3f3-75f62af9a1f5 tempest-TestStampPattern-322079569 tempest-TestStampPattern-322079569-project-member] Lock "5a24033f-5bf1-4747-a8f4-3edc32600a9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.249s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:19:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:19:40 user nova-compute[72409]: INFO nova.compute.manager [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Detaching volume ad3e297f-025b-49cf-9968-9c1ae75cfe0a
Aug 09 23:19:40 user nova-compute[72409]: INFO nova.virt.block_device [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Attempting to driver detach volume ad3e297f-025b-49cf-9968-9c1ae75cfe0a from mountpoint /dev/vdb
Aug 09 23:19:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Attempting to detach device vdb from instance 76e542ee-fc49-430c-b2c3-2cd2913075a0 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:19:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:19:40 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:19:40 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:19:40 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:19:40 user nova-compute[72409]:   <serial>ad3e297f-025b-49cf-9968-9c1ae75cfe0a</serial>
Aug 09 23:19:40 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:19:40 user nova-compute[72409]: </disk>
Aug 09 23:19:40 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:19:40 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Successfully detached device vdb from instance 76e542ee-fc49-430c-b2c3-2cd2913075a0 from the persistent domain config.
Aug 09 23:19:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76e542ee-fc49-430c-b2c3-2cd2913075a0 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:19:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:19:40 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:19:40 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:19:40 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:19:40 user nova-compute[72409]:   <serial>ad3e297f-025b-49cf-9968-9c1ae75cfe0a</serial>
Aug 09 23:19:40 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:19:40 user nova-compute[72409]: </disk>
Aug 09 23:19:40 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-changed-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Refreshing instance network info cache due to event network-changed-d115dd28-4650-4494-8fb0-d387a77b1600. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] Acquiring lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] Acquired lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG nova.network.neutron [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Refreshing network info cache for port d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691623181.3577776, 76e542ee-fc49-430c-b2c3-2cd2913075a0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:19:41 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Successfully detached device vdb from instance 76e542ee-fc49-430c-b2c3-2cd2913075a0 from the live domain config.
Aug 09 23:19:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBwEuNmz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:19:41 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d68146d-b657-45d1-aed4-b1d8a775ac19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9175ec-7c84-4f37-8d35-5976badb9f4f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:19:41 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a (non-flash)
Aug 09 23:19:41 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84289cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc412c9-380b-4498-a4c2-a89d73db1b25]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed4c020-b2e0-49ff-b2be-fdeefd14b066]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97ea018-b451-454f-ba9e-0bd50a617fc8]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f4b1a0-0ab4-45e4-8fe7-15ec7517d191]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1571759c-2c3b-4a85-ba2e-f53a6d04fb85]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[576a5ea0-4cd4-4cef-956b-2093bff4f32b]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a, portal: 172.16.0.220,3260]
Aug 09 23:19:41 user nova-compute[72409]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a, portal: 172.16.0.220,3260] successful.
Aug 09 23:19:41 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad3e297f-025b-49cf-9968-9c1ae75cfe0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47f5cdc-7108-4b25-8541-55d290f4bdbd]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] <== disconnect_volume: return (291ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG nova.network.neutron [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updated VIF entry in instance network info cache for port d115dd28-4650-4494-8fb0-d387a77b1600. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG nova.network.neutron [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updating instance_info_cache with network_info: [{"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] Releasing lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-changed-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG nova.compute.manager [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Refreshing instance network info cache due to event network-changed-d115dd28-4650-4494-8fb0-d387a77b1600. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] Acquiring lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] Acquired lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:19:41 user nova-compute[72409]: DEBUG nova.network.neutron [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Refreshing network info cache for port d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:19:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:42 user nova-compute[72409]: DEBUG nova.network.neutron [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updated VIF entry in instance network info cache for port d115dd28-4650-4494-8fb0-d387a77b1600. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:19:42 user nova-compute[72409]: DEBUG nova.network.neutron [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updating instance_info_cache with network_info: [{"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:19:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bc5f5de7-2cf5-4e36-a3eb-7b0e6dadf14d req-68acba65-21aa-411a-9380-55c8cdc4464d service nova] Releasing lock "refresh_cache-76e542ee-fc49-430c-b2c3-2cd2913075a0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:19:42 user nova-compute[72409]: DEBUG nova.objects.instance [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'flavor' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:19:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-99950ca3-44eb-49c6-bc98-c5bffd5fc05f tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.690s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:19:43 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691623168.0718858, c43b9b78-3237-4cb0-be8a-0b3ec6e53aba => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:19:43 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] VM Stopped (Lifecycle Event)
Aug 09 23:19:43 user nova-compute[72409]: DEBUG nova.compute.manager [None req-89b2d14f-0524-497d-8b80-00ab78476d6b None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:19:43 user nova-compute[72409]: DEBUG nova.compute.manager [None req-89b2d14f-0524-497d-8b80-00ab78476d6b None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:19:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:19:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:19:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:19:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:19:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:53 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691623178.0721395, 5a24033f-5bf1-4747-a8f4-3edc32600a9a => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:19:53 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] VM Stopped (Lifecycle Event)
Aug 09 23:19:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-61260d6b-2172-45b4-9bf5-1266c71feae4 None None] [instance: 5a24033f-5bf1-4747-a8f4-3edc32600a9a] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:19:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:19:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:19:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:19:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:19:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:19:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:20:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:20:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:20:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:20:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:20:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:11 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:20:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:20:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:20:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:20:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:20:12 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:20:12 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:20:12 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:20:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:20:14 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:20:14 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:20:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8556MB free_disk=25.247379302978516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 76e542ee-fc49-430c-b2c3-2cd2913075a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:20:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:20:15 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:20:15 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:20:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:20:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:20:16 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:20:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:20:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:20:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:20:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:20:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:20:19 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:20:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:20:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:20:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:20:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:20:20 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:20:20 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:20:20 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Updating instance_info_cache with network_info: [{"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:20:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-8f7e2151-3d32-4ec8-9903-f5f284879ae0" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:20:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:20:22 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:20:22 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:20:22 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:20:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:20:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:20:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:20:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:20:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:20:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:20:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:20:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:20:31 user nova-compute[72409]: INFO nova.compute.manager [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Terminating instance
Aug 09 23:20:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-94133d5f-f435-4b3c-822c-a9d9715ae364 req-5b85fcb4-b279-4c21-9bb4-46ec16e2af16 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-unplugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-94133d5f-f435-4b3c-822c-a9d9715ae364 req-5b85fcb4-b279-4c21-9bb4-46ec16e2af16 service nova] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-94133d5f-f435-4b3c-822c-a9d9715ae364 req-5b85fcb4-b279-4c21-9bb4-46ec16e2af16 service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-94133d5f-f435-4b3c-822c-a9d9715ae364 req-5b85fcb4-b279-4c21-9bb4-46ec16e2af16 service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-94133d5f-f435-4b3c-822c-a9d9715ae364 req-5b85fcb4-b279-4c21-9bb4-46ec16e2af16 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] No waiting events found dispatching network-vif-unplugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-94133d5f-f435-4b3c-822c-a9d9715ae364 req-5b85fcb4-b279-4c21-9bb4-46ec16e2af16 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-unplugged-d115dd28-4650-4494-8fb0-d387a77b1600 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Instance destroyed successfully.
Aug 09 23:20:32 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'resources' on Instance uuid 76e542ee-fc49-430c-b2c3-2cd2913075a0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:20:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-899627340',display_name='tempest-ServerRescueNegativeTestJSON-server-899627340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-899627340',id=44,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+Br0sqy7btjDPu+x0UxuVaCzJxyOFJSXaS/DTk5G+W8EKbv1EgqwSxTUZklmQSJqsdwz/nAqjT9MvfhoEmk2kJC5gxj7MsfxATlRr4Evjp0O4tu0pw/TG7W96oZ+VJRg==',key_name='tempest-keypair-960642969',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:16:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d41897ed2b644775a5dcb22d1ecd60a0',ramdisk_id='',reservation_id='r-v0xxbfd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-850997564',owner_user_name='tempest-ServerRescueNegativeTestJSON-850997564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de2d9f7ad5bb4a93ab61ab100eb1778d',uuid=76e542ee-fc49-430c-b2c3-2cd2913075a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:20:32 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converting VIF {"id": "d115dd28-4650-4494-8fb0-d387a77b1600", "address": "fa:16:3e:68:90:c5", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115dd28-46", "ovs_interfaceid": "d115dd28-4650-4494-8fb0-d387a77b1600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:20:32 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=d115dd28-4650-4494-8fb0-d387a77b1600,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115dd28-46') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:20:32 user nova-compute[72409]: DEBUG os_vif [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=d115dd28-4650-4494-8fb0-d387a77b1600,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115dd28-46') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:20:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd115dd28-46, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:20:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:20:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:32 user nova-compute[72409]: INFO os_vif [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:90:c5,bridge_name='br-int',has_traffic_filtering=True,id=d115dd28-4650-4494-8fb0-d387a77b1600,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115dd28-46')
Aug 09 23:20:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Deleting instance files /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0_del
Aug 09 23:20:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Deletion of /opt/stack/data/nova/instances/76e542ee-fc49-430c-b2c3-2cd2913075a0_del complete
Aug 09 23:20:32 user nova-compute[72409]: INFO nova.compute.manager [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 23:20:32 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:20:32 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:20:32 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:20:32 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:20:32 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Took 0.79 seconds to deallocate network for instance.
Aug 09 23:20:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-5121aced-11da-4f51-9597-87aa618ccbd4 req-2080adc1-ade1-4899-827e-efd863988217 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-deleted-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:20:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:20:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:20:33 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:20:33 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:20:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:20:33 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Deleted allocations for instance 76e542ee-fc49-430c-b2c3-2cd2913075a0
Aug 09 23:20:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a0540a19-6f07-4ae3-84fa-ed867007eb2a tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.121s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:20:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-881b63c2-40d5-4678-b7c7-e70115de60a7 req-4a367d7a-435f-4eac-aee4-004eb4253f11 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:20:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-881b63c2-40d5-4678-b7c7-e70115de60a7 req-4a367d7a-435f-4eac-aee4-004eb4253f11 service nova] Acquiring lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:20:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-881b63c2-40d5-4678-b7c7-e70115de60a7 req-4a367d7a-435f-4eac-aee4-004eb4253f11 service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:20:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-881b63c2-40d5-4678-b7c7-e70115de60a7 req-4a367d7a-435f-4eac-aee4-004eb4253f11 service nova] Lock "76e542ee-fc49-430c-b2c3-2cd2913075a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:20:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-881b63c2-40d5-4678-b7c7-e70115de60a7 req-4a367d7a-435f-4eac-aee4-004eb4253f11 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] No waiting events found dispatching network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:20:33 user nova-compute[72409]: WARNING nova.compute.manager [req-881b63c2-40d5-4678-b7c7-e70115de60a7 req-4a367d7a-435f-4eac-aee4-004eb4253f11 service nova] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Received unexpected event network-vif-plugged-d115dd28-4650-4494-8fb0-d387a77b1600 for instance with vm_state deleted and task_state None.
Aug 09 23:20:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:47 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691623232.002354, 76e542ee-fc49-430c-b2c3-2cd2913075a0 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:20:47 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] VM Stopped (Lifecycle Event)
Aug 09 23:20:47 user nova-compute[72409]: DEBUG nova.compute.manager [None req-599e9cd4-4be6-4f3b-af53-7a2451ccb403 None None] [instance: 76e542ee-fc49-430c-b2c3-2cd2913075a0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:20:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:20:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:04 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:21:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 23:21:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:21:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:21:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:21:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:21:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:21:13 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:21:13 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 23:21:13 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] There are 0 instances to clean {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 23:21:14 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:21:14 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:21:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:21:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:21:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:21:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:21:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:21:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:21:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:21:16 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:21:16 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:21:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=25.274028778076172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:21:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:21:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:21:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:21:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance a074c83c-2e90-4675-89dc-4006294cfdee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:21:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:21:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:21:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:21:16 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing inventories for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 23:21:16 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating ProviderTree inventory for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 23:21:16 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 23:21:16 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing aggregate associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, aggregates: None {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 23:21:17 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing trait associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 23:21:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:17 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:21:17 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:21:17 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:21:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.628s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquired lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.network.neutron [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'info_cache' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.network.neutron [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updating instance_info_cache with network_info: [{"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Releasing lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:21:18 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance destroyed successfully.
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'resources' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-158408380',display_name='tempest-AttachVolumeTestJSON-server-158408380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-158408380',id=43,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7cyVxAqMw/gmzCUNmkaDKLkx5O4eZ4SJ14bCtziFqZelGzHQrhavYLL+rKID1RcDRMeRuc/KiuUItVmoh138Xg+EqTD2HksOySvGeMflViOS+DxVsxR1mjmffB7SuBiA==',key_name='tempest-keypair-867359187',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:13:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5148973bc704627aeccf788e9ac4412',ramdisk_id='',reservation_id='r-hclxvq1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885013657',owner_user_name='tempest-AttachVolumeTestJSON-1885013657-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='404739e50bd042d29d060fb39c1f8c4a',uuid=c43b9b78-3237-4cb0-be8a-0b3ec6e53aba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converting VIF {"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG os_vif [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap051b3c51-48, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:21:18 user nova-compute[72409]: INFO os_vif [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48')
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Start _get_guest_xml network_info=[{"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'numa_topology' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:21:18 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:21:18 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'vcpu_model' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-158408380',display_name='tempest-AttachVolumeTestJSON-server-158408380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-158408380',id=43,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7cyVxAqMw/gmzCUNmkaDKLkx5O4eZ4SJ14bCtziFqZelGzHQrhavYLL+rKID1RcDRMeRuc/KiuUItVmoh138Xg+EqTD2HksOySvGeMflViOS+DxVsxR1mjmffB7SuBiA==',key_name='tempest-keypair-867359187',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:13:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b5148973bc704627aeccf788e9ac4412',ramdisk_id='',reservation_id='r-hclxvq1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885013657',owner_user_name='tempest-AttachVolumeTestJSON-1885013657-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='404739e50bd042d29d060fb39c1f8c4a',uuid=c43b9b78-3237-4cb0-be8a-0b3ec6e53aba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converting VIF {"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'pci_devices' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:21:18 user nova-compute[72409]:   <uuid>c43b9b78-3237-4cb0-be8a-0b3ec6e53aba</uuid>
Aug 09 23:21:18 user nova-compute[72409]:   <name>instance-0000002b</name>
Aug 09 23:21:18 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:21:18 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:21:18 user nova-compute[72409]:   <metadata>
Aug 09 23:21:18 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:21:18 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:21:18 user nova-compute[72409]:       <nova:name>tempest-AttachVolumeTestJSON-server-158408380</nova:name>
Aug 09 23:21:18 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:21:18</nova:creationTime>
Aug 09 23:21:18 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:21:18 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:21:18 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:21:18 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:21:18 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:21:18 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:21:18 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:21:18 user nova-compute[72409]:       <nova:owner>
Aug 09 23:21:18 user nova-compute[72409]:         <nova:user uuid="404739e50bd042d29d060fb39c1f8c4a">tempest-AttachVolumeTestJSON-1885013657-project-member</nova:user>
Aug 09 23:21:18 user nova-compute[72409]:         <nova:project uuid="b5148973bc704627aeccf788e9ac4412">tempest-AttachVolumeTestJSON-1885013657</nova:project>
Aug 09 23:21:18 user nova-compute[72409]:       </nova:owner>
Aug 09 23:21:18 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:21:18 user nova-compute[72409]:       <nova:ports>
Aug 09 23:21:18 user nova-compute[72409]:         <nova:port uuid="051b3c51-4821-4807-b65f-f5fe5894509c">
Aug 09 23:21:18 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 23:21:18 user nova-compute[72409]:         </nova:port>
Aug 09 23:21:18 user nova-compute[72409]:       </nova:ports>
Aug 09 23:21:18 user nova-compute[72409]:     </nova:instance>
Aug 09 23:21:18 user nova-compute[72409]:   </metadata>
Aug 09 23:21:18 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:21:18 user nova-compute[72409]:     <system>
Aug 09 23:21:18 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:21:18 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:21:18 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:21:18 user nova-compute[72409]:       <entry name="serial">c43b9b78-3237-4cb0-be8a-0b3ec6e53aba</entry>
Aug 09 23:21:18 user nova-compute[72409]:       <entry name="uuid">c43b9b78-3237-4cb0-be8a-0b3ec6e53aba</entry>
Aug 09 23:21:18 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:21:18 user nova-compute[72409]:     </system>
Aug 09 23:21:18 user nova-compute[72409]:   </sysinfo>
Aug 09 23:21:18 user nova-compute[72409]:   <os>
Aug 09 23:21:18 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:21:18 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:21:18 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:21:18 user nova-compute[72409]:   </os>
Aug 09 23:21:18 user nova-compute[72409]:   <features>
Aug 09 23:21:18 user nova-compute[72409]:     <acpi/>
Aug 09 23:21:18 user nova-compute[72409]:     <apic/>
Aug 09 23:21:18 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:21:18 user nova-compute[72409]:   </features>
Aug 09 23:21:18 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:21:18 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:21:18 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:21:18 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:21:18 user nova-compute[72409]:   </clock>
Aug 09 23:21:18 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:21:18 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:21:18 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:21:18 user nova-compute[72409]:   </cpu>
Aug 09 23:21:18 user nova-compute[72409]:   <devices>
Aug 09 23:21:18 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:21:18 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:21:18 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk"/>
Aug 09 23:21:18 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:21:18 user nova-compute[72409]:     </disk>
Aug 09 23:21:18 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:21:18 user nova-compute[72409]:       <mac address="fa:16:3e:19:e9:13"/>
Aug 09 23:21:18 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:21:18 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:21:18 user nova-compute[72409]:       <target dev="tap051b3c51-48"/>
Aug 09 23:21:18 user nova-compute[72409]:     </interface>
Aug 09 23:21:18 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:21:18 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/console.log" append="off"/>
Aug 09 23:21:18 user nova-compute[72409]:     </serial>
Aug 09 23:21:18 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:21:18 user nova-compute[72409]:     <video>
Aug 09 23:21:18 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:21:18 user nova-compute[72409]:     </video>
Aug 09 23:21:18 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:21:18 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:21:18 user nova-compute[72409]:     </rng>
Aug 09 23:21:18 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:21:18 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:21:18 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:21:18 user nova-compute[72409]:     </memballoon>
Aug 09 23:21:18 user nova-compute[72409]:   </devices>
Aug 09 23:21:18 user nova-compute[72409]: </domain>
Aug 09 23:21:18 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:21:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'trusted_certs' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Cannot resize image /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'migration_context' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-158408380',display_name='tempest-AttachVolumeTestJSON-server-158408380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-158408380',id=43,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7cyVxAqMw/gmzCUNmkaDKLkx5O4eZ4SJ14bCtziFqZelGzHQrhavYLL+rKID1RcDRMeRuc/KiuUItVmoh138Xg+EqTD2HksOySvGeMflViOS+DxVsxR1mjmffB7SuBiA==',key_name='tempest-keypair-867359187',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:13:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b5148973bc704627aeccf788e9ac4412',ramdisk_id='',reservation_id='r-hclxvq1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885013657',owner_user_name='tempest-AttachVolumeTestJSON-1885013657-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='404739e50bd042d29d060fb39c1f8c4a',uuid=c43b9b78-3237-4cb0-be8a-0b3ec6e53aba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converting VIF {"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG os_vif [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap051b3c51-48, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap051b3c51-48, col_values=(('external_ids', {'iface-id': '051b3c51-4821-4807-b65f-f5fe5894509c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:e9:13', 'vm-uuid': 'c43b9b78-3237-4cb0-be8a-0b3ec6e53aba'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:21:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:19 user nova-compute[72409]: INFO os_vif [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48')
Aug 09 23:21:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-3f1576bd-9678-4587-8953-3752304b7c33 req-340ed422-a77f-475e-a3bd-9e21b55e8c59 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:21:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3f1576bd-9678-4587-8953-3752304b7c33 req-340ed422-a77f-475e-a3bd-9e21b55e8c59 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:21:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3f1576bd-9678-4587-8953-3752304b7c33 req-340ed422-a77f-475e-a3bd-9e21b55e8c59 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:21:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3f1576bd-9678-4587-8953-3752304b7c33 req-340ed422-a77f-475e-a3bd-9e21b55e8c59 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:21:21 user nova-compute[72409]: DEBUG nova.compute.manager [req-3f1576bd-9678-4587-8953-3752304b7c33 req-340ed422-a77f-475e-a3bd-9e21b55e8c59 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:21:21 user nova-compute[72409]: WARNING nova.compute.manager [req-3f1576bd-9678-4587-8953-3752304b7c33 req-340ed422-a77f-475e-a3bd-9e21b55e8c59 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state stopped and task_state powering-on.
Aug 09 23:21:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Updating instance_info_cache with network_info: [{"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-a074c83c-2e90-4675-89dc-4006294cfdee" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:21:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:21:23 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623283.0018988, c43b9b78-3237-4cb0-be8a-0b3ec6e53aba => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:21:23 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] VM Resumed (Lifecycle Event)
Aug 09 23:21:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:21:23 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance rebooted successfully.
Aug 09 23:21:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-b8063dcb-705b-4add-9251-901006133ca8 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:21:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:21:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:21:23 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 23:21:23 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623283.0031097, c43b9b78-3237-4cb0-be8a-0b3ec6e53aba => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:21:23 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] VM Started (Lifecycle Event)
Aug 09 23:21:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:21:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:21:23 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 23:21:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-33142f6e-f941-40d4-bfcf-44982a4df32e req-fbfc7408-697f-427e-bcb0-bdb71736bd25 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:21:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-33142f6e-f941-40d4-bfcf-44982a4df32e req-fbfc7408-697f-427e-bcb0-bdb71736bd25 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:21:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-33142f6e-f941-40d4-bfcf-44982a4df32e req-fbfc7408-697f-427e-bcb0-bdb71736bd25 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:21:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-33142f6e-f941-40d4-bfcf-44982a4df32e req-fbfc7408-697f-427e-bcb0-bdb71736bd25 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:21:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-33142f6e-f941-40d4-bfcf-44982a4df32e req-fbfc7408-697f-427e-bcb0-bdb71736bd25 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:21:23 user nova-compute[72409]: WARNING nova.compute.manager [req-33142f6e-f941-40d4-bfcf-44982a4df32e req-fbfc7408-697f-427e-bcb0-bdb71736bd25 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state active and task_state None.
Aug 09 23:21:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:21:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:24 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:21:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "a074c83c-2e90-4675-89dc-4006294cfdee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:21:34 user nova-compute[72409]: INFO nova.compute.manager [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Terminating instance
Aug 09 23:21:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG nova.compute.manager [req-dc98bf7e-bb5a-4863-93c2-afd2321498c2 req-791bcfbc-67ee-47ca-bc27-a9505911339e service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received event network-vif-unplugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dc98bf7e-bb5a-4863-93c2-afd2321498c2 req-791bcfbc-67ee-47ca-bc27-a9505911339e service nova] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dc98bf7e-bb5a-4863-93c2-afd2321498c2 req-791bcfbc-67ee-47ca-bc27-a9505911339e service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-dc98bf7e-bb5a-4863-93c2-afd2321498c2 req-791bcfbc-67ee-47ca-bc27-a9505911339e service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG nova.compute.manager [req-dc98bf7e-bb5a-4863-93c2-afd2321498c2 req-791bcfbc-67ee-47ca-bc27-a9505911339e service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] No waiting events found dispatching network-vif-unplugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG nova.compute.manager [req-dc98bf7e-bb5a-4863-93c2-afd2321498c2 req-791bcfbc-67ee-47ca-bc27-a9505911339e service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received event network-vif-unplugged-7849914d-f21b-4fcc-b83c-47dc070987ec for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Instance destroyed successfully.
Aug 09 23:21:35 user nova-compute[72409]: DEBUG nova.objects.instance [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'resources' on Instance uuid a074c83c-2e90-4675-89dc-4006294cfdee {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2016255152',display_name='tempest-ServerRescueNegativeTestJSON-server-2016255152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2016255152',id=37,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:07:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d41897ed2b644775a5dcb22d1ecd60a0',ramdisk_id='',reservation_id='r-zlpivyg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-850997564',owner_user_name='tempest-ServerRescueNegativeTestJSON-850997564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:07:17Z,user_data=None,user_id='de2d9f7ad5bb4a93ab61ab100eb1778d',uuid=a074c83c-2e90-4675-89dc-4006294cfdee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converting VIF {"id": "7849914d-f21b-4fcc-b83c-47dc070987ec", "address": "fa:16:3e:cf:d5:11", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7849914d-f2", "ovs_interfaceid": "7849914d-f21b-4fcc-b83c-47dc070987ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:d5:11,bridge_name='br-int',has_traffic_filtering=True,id=7849914d-f21b-4fcc-b83c-47dc070987ec,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7849914d-f2') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG os_vif [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:d5:11,bridge_name='br-int',has_traffic_filtering=True,id=7849914d-f21b-4fcc-b83c-47dc070987ec,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7849914d-f2') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7849914d-f2, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:21:35 user nova-compute[72409]: INFO os_vif [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:d5:11,bridge_name='br-int',has_traffic_filtering=True,id=7849914d-f21b-4fcc-b83c-47dc070987ec,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7849914d-f2')
Aug 09 23:21:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Deleting instance files /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee_del
Aug 09 23:21:35 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Deletion of /opt/stack/data/nova/instances/a074c83c-2e90-4675-89dc-4006294cfdee_del complete
Aug 09 23:21:35 user nova-compute[72409]: INFO nova.compute.manager [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 23:21:35 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:21:35 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Took 0.50 seconds to deallocate network for instance.
Aug 09 23:21:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-49f0b708-de64-447c-ad07-de6b4dc1cbfe req-8f3b5e73-9901-4993-af00-c827c0865712 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received event network-vif-deleted-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:21:35 user nova-compute[72409]: INFO nova.compute.manager [req-49f0b708-de64-447c-ad07-de6b4dc1cbfe req-8f3b5e73-9901-4993-af00-c827c0865712 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Neutron deleted interface 7849914d-f21b-4fcc-b83c-47dc070987ec; detaching it from the instance and deleting it from the info cache
Aug 09 23:21:35 user nova-compute[72409]: DEBUG nova.network.neutron [req-49f0b708-de64-447c-ad07-de6b4dc1cbfe req-8f3b5e73-9901-4993-af00-c827c0865712 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-49f0b708-de64-447c-ad07-de6b4dc1cbfe req-8f3b5e73-9901-4993-af00-c827c0865712 service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Detach interface failed, port_id=7849914d-f21b-4fcc-b83c-47dc070987ec, reason: Instance a074c83c-2e90-4675-89dc-4006294cfdee could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:21:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:21:36 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:21:36 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:21:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:21:36 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Deleted allocations for instance a074c83c-2e90-4675-89dc-4006294cfdee
Aug 09 23:21:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-e1efbdb5-27bb-4ef4-a69f-0de2c1385e6e tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "a074c83c-2e90-4675-89dc-4006294cfdee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.802s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:21:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-2bcbbc5a-bc4c-4385-8bc6-bce0751dd9a3 req-474327c2-8970-49d7-82e1-c20ab21461ed service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received event network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:21:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2bcbbc5a-bc4c-4385-8bc6-bce0751dd9a3 req-474327c2-8970-49d7-82e1-c20ab21461ed service nova] Acquiring lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:21:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2bcbbc5a-bc4c-4385-8bc6-bce0751dd9a3 req-474327c2-8970-49d7-82e1-c20ab21461ed service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:21:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-2bcbbc5a-bc4c-4385-8bc6-bce0751dd9a3 req-474327c2-8970-49d7-82e1-c20ab21461ed service nova] Lock "a074c83c-2e90-4675-89dc-4006294cfdee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:21:36 user nova-compute[72409]: DEBUG nova.compute.manager [req-2bcbbc5a-bc4c-4385-8bc6-bce0751dd9a3 req-474327c2-8970-49d7-82e1-c20ab21461ed service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] No waiting events found dispatching network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:21:36 user nova-compute[72409]: WARNING nova.compute.manager [req-2bcbbc5a-bc4c-4385-8bc6-bce0751dd9a3 req-474327c2-8970-49d7-82e1-c20ab21461ed service nova] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Received unexpected event network-vif-plugged-7849914d-f21b-4fcc-b83c-47dc070987ec for instance with vm_state deleted and task_state None.
Aug 09 23:21:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:21:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:50 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691623295.1661274, a074c83c-2e90-4675-89dc-4006294cfdee => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:21:50 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] VM Stopped (Lifecycle Event)
Aug 09 23:21:50 user nova-compute[72409]: DEBUG nova.compute.manager [None req-970712c3-0dbf-435d-b2d9-aa103d23db58 None None] [instance: a074c83c-2e90-4675-89dc-4006294cfdee] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:21:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:21:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:22:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:22:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:22:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:22:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:22:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:22:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:22:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:22:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:22:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:22:14 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:22:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:22:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:22:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:22:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:22:14 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:22:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:22:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:22:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:22:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:22:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:22:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:22:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:22:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:22:15 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:22:15 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:22:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8688MB free_disk=25.30047607421875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:22:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:22:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:22:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:22:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:22:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:22:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:22:16 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:22:16 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:22:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:22:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:22:17 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:22:17 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:22:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:22:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:22:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:22:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:22:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:22:20 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:22:21 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updating instance_info_cache with network_info: [{"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:22:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:22:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:22:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:22:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:22:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:22:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:22:24 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:22:24 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:22:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:22:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:22:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:22:25 user nova-compute[72409]: INFO nova.compute.manager [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Terminating instance
Aug 09 23:22:25 user nova-compute[72409]: DEBUG nova.compute.manager [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-c9f91092-7b5e-4445-9a10-90bf81d66672 req-578583b9-c434-4913-acd9-e2d795d568e2 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-unplugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c9f91092-7b5e-4445-9a10-90bf81d66672 req-578583b9-c434-4913-acd9-e2d795d568e2 service nova] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c9f91092-7b5e-4445-9a10-90bf81d66672 req-578583b9-c434-4913-acd9-e2d795d568e2 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c9f91092-7b5e-4445-9a10-90bf81d66672 req-578583b9-c434-4913-acd9-e2d795d568e2 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-c9f91092-7b5e-4445-9a10-90bf81d66672 req-578583b9-c434-4913-acd9-e2d795d568e2 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] No waiting events found dispatching network-vif-unplugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-c9f91092-7b5e-4445-9a10-90bf81d66672 req-578583b9-c434-4913-acd9-e2d795d568e2 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-unplugged-7854b9ac-e7ec-486d-9e13-de3581f75379 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:22:25 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Instance destroyed successfully.
Aug 09 23:22:25 user nova-compute[72409]: DEBUG nova.objects.instance [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lazy-loading 'resources' on Instance uuid 8f7e2151-3d32-4ec8-9903-f5f284879ae0 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-450043224',display_name='tempest-ServerRescueNegativeTestJSON-server-450043224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-450043224',id=36,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:10:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d41897ed2b644775a5dcb22d1ecd60a0',ramdisk_id='',reservation_id='r-l9q8760o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-850997564',owner_user_name='tempest-ServerRescueNegativeTestJSON-850997564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:12:02Z,user_data=None,user_id='de2d9f7ad5bb4a93ab61ab100eb1778d',uuid=8f7e2151-3d32-4ec8-9903-f5f284879ae0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converting VIF {"id": "7854b9ac-e7ec-486d-9e13-de3581f75379", "address": "fa:16:3e:aa:78:71", "network": {"id": "24b9e5b0-5125-4e90-aa87-96c5de352040", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2106879569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d41897ed2b644775a5dcb22d1ecd60a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7854b9ac-e7", "ovs_interfaceid": "7854b9ac-e7ec-486d-9e13-de3581f75379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:78:71,bridge_name='br-int',has_traffic_filtering=True,id=7854b9ac-e7ec-486d-9e13-de3581f75379,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7854b9ac-e7') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG os_vif [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:78:71,bridge_name='br-int',has_traffic_filtering=True,id=7854b9ac-e7ec-486d-9e13-de3581f75379,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7854b9ac-e7') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7854b9ac-e7, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:22:25 user nova-compute[72409]: INFO os_vif [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:78:71,bridge_name='br-int',has_traffic_filtering=True,id=7854b9ac-e7ec-486d-9e13-de3581f75379,network=Network(24b9e5b0-5125-4e90-aa87-96c5de352040),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7854b9ac-e7')
Aug 09 23:22:25 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Deleting instance files /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0_del
Aug 09 23:22:25 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Deletion of /opt/stack/data/nova/instances/8f7e2151-3d32-4ec8-9903-f5f284879ae0_del complete
Aug 09 23:22:25 user nova-compute[72409]: INFO nova.compute.manager [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 09 23:22:25 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:22:25 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:22:26 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:22:26 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Took 0.51 seconds to deallocate network for instance.
Aug 09 23:22:26 user nova-compute[72409]: DEBUG nova.compute.manager [req-b9ced275-7684-4725-95dd-21fd4ce3b2b0 req-b6ccffb6-2a02-41a5-8f94-97e52af6ed2e service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-deleted-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:22:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:22:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:22:26 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:22:26 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:22:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:22:26 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Deleted allocations for instance 8f7e2151-3d32-4ec8-9903-f5f284879ae0
Aug 09 23:22:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-77abfcc9-fb87-4f6d-bc26-097c1292c50d tempest-ServerRescueNegativeTestJSON-850997564 tempest-ServerRescueNegativeTestJSON-850997564-project-member] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.685s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:22:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-8a8363d2-d3b8-42f6-b7f4-001cf4bd1abe req-5d773998-0b87-43f3-9766-5f2143bcc496 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:22:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8a8363d2-d3b8-42f6-b7f4-001cf4bd1abe req-5d773998-0b87-43f3-9766-5f2143bcc496 service nova] Acquiring lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:22:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8a8363d2-d3b8-42f6-b7f4-001cf4bd1abe req-5d773998-0b87-43f3-9766-5f2143bcc496 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:22:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-8a8363d2-d3b8-42f6-b7f4-001cf4bd1abe req-5d773998-0b87-43f3-9766-5f2143bcc496 service nova] Lock "8f7e2151-3d32-4ec8-9903-f5f284879ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:22:27 user nova-compute[72409]: DEBUG nova.compute.manager [req-8a8363d2-d3b8-42f6-b7f4-001cf4bd1abe req-5d773998-0b87-43f3-9766-5f2143bcc496 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] No waiting events found dispatching network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:22:27 user nova-compute[72409]: WARNING nova.compute.manager [req-8a8363d2-d3b8-42f6-b7f4-001cf4bd1abe req-5d773998-0b87-43f3-9766-5f2143bcc496 service nova] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Received unexpected event network-vif-plugged-7854b9ac-e7ec-486d-9e13-de3581f75379 for instance with vm_state deleted and task_state None.
Aug 09 23:22:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:22:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:22:40 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691623345.7539434, 8f7e2151-3d32-4ec8-9903-f5f284879ae0 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:22:40 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] VM Stopped (Lifecycle Event)
Aug 09 23:22:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d11f5161-0d96-4fdc-bb8d-de4ae662cf26 None None] [instance: 8f7e2151-3d32-4ec8-9903-f5f284879ae0] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:22:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:22:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:22:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:22:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:23:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:23:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:23:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:23:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:23:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:23:09 user nova-compute[72409]: INFO nova.compute.manager [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Terminating instance
Aug 09 23:23:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-1197bafa-1368-4a49-88c1-3e130a794dc5 req-ca3cdf62-853e-465f-b3d6-6fc25b4ec636 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-unplugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1197bafa-1368-4a49-88c1-3e130a794dc5 req-ca3cdf62-853e-465f-b3d6-6fc25b4ec636 service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1197bafa-1368-4a49-88c1-3e130a794dc5 req-ca3cdf62-853e-465f-b3d6-6fc25b4ec636 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1197bafa-1368-4a49-88c1-3e130a794dc5 req-ca3cdf62-853e-465f-b3d6-6fc25b4ec636 service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-1197bafa-1368-4a49-88c1-3e130a794dc5 req-ca3cdf62-853e-465f-b3d6-6fc25b4ec636 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-unplugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-1197bafa-1368-4a49-88c1-3e130a794dc5 req-ca3cdf62-853e-465f-b3d6-6fc25b4ec636 service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-unplugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:23:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:10 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Instance destroyed successfully.
Aug 09 23:23:10 user nova-compute[72409]: DEBUG nova.objects.instance [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'resources' on Instance uuid c43b9b78-3237-4cb0-be8a-0b3ec6e53aba {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:23:10 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-158408380',display_name='tempest-AttachVolumeTestJSON-server-158408380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-158408380',id=43,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7cyVxAqMw/gmzCUNmkaDKLkx5O4eZ4SJ14bCtziFqZelGzHQrhavYLL+rKID1RcDRMeRuc/KiuUItVmoh138Xg+EqTD2HksOySvGeMflViOS+DxVsxR1mjmffB7SuBiA==',key_name='tempest-keypair-867359187',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:13:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5148973bc704627aeccf788e9ac4412',ramdisk_id='',reservation_id='r-hclxvq1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885013657',owner_user_name='tempest-AttachVolumeTestJSON-1885013657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='404739e50bd042d29d060fb39c1f8c4a',uuid=c43b9b78-3237-4cb0-be8a-0b3ec6e53aba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:23:10 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converting VIF {"id": "051b3c51-4821-4807-b65f-f5fe5894509c", "address": "fa:16:3e:19:e9:13", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap051b3c51-48", "ovs_interfaceid": "051b3c51-4821-4807-b65f-f5fe5894509c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:23:10 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:23:10 user nova-compute[72409]: DEBUG os_vif [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:23:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap051b3c51-48, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:23:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:23:10 user nova-compute[72409]: INFO os_vif [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:e9:13,bridge_name='br-int',has_traffic_filtering=True,id=051b3c51-4821-4807-b65f-f5fe5894509c,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap051b3c51-48')
Aug 09 23:23:10 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Deleting instance files /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba_del
Aug 09 23:23:10 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Deletion of /opt/stack/data/nova/instances/c43b9b78-3237-4cb0-be8a-0b3ec6e53aba_del complete
Aug 09 23:23:10 user nova-compute[72409]: INFO nova.compute.manager [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 23:23:10 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:23:10 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:23:10 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:23:11 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:23:11 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Took 1.20 seconds to deallocate network for instance.
Aug 09 23:23:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:23:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:23:11 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:23:11 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:23:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:23:11 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Deleted allocations for instance c43b9b78-3237-4cb0-be8a-0b3ec6e53aba
Aug 09 23:23:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-0a0b49d0-5294-46a7-b9f3-c5f1f896e306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:23:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-f7f65250-fc96-494e-8f95-edb9abfebbb5 req-de6bb2bf-abeb-4b59-9fb4-5c6066159cbc service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:23:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f7f65250-fc96-494e-8f95-edb9abfebbb5 req-de6bb2bf-abeb-4b59-9fb4-5c6066159cbc service nova] Acquiring lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:23:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f7f65250-fc96-494e-8f95-edb9abfebbb5 req-de6bb2bf-abeb-4b59-9fb4-5c6066159cbc service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:23:11 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f7f65250-fc96-494e-8f95-edb9abfebbb5 req-de6bb2bf-abeb-4b59-9fb4-5c6066159cbc service nova] Lock "c43b9b78-3237-4cb0-be8a-0b3ec6e53aba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:23:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-f7f65250-fc96-494e-8f95-edb9abfebbb5 req-de6bb2bf-abeb-4b59-9fb4-5c6066159cbc service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] No waiting events found dispatching network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:23:11 user nova-compute[72409]: WARNING nova.compute.manager [req-f7f65250-fc96-494e-8f95-edb9abfebbb5 req-de6bb2bf-abeb-4b59-9fb4-5c6066159cbc service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received unexpected event network-vif-plugged-051b3c51-4821-4807-b65f-f5fe5894509c for instance with vm_state deleted and task_state None.
Aug 09 23:23:11 user nova-compute[72409]: DEBUG nova.compute.manager [req-f7f65250-fc96-494e-8f95-edb9abfebbb5 req-de6bb2bf-abeb-4b59-9fb4-5c6066159cbc service nova] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Received event network-vif-deleted-051b3c51-4821-4807-b65f-f5fe5894509c {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:23:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:23:14 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:23:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:23:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:23:14 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:23:14 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:23:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:15 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:23:15 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:23:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=25.356067657470703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:23:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:23:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:23:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:23:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:23:15 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:23:15 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:23:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:23:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:23:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:19 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:23:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:23:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:23:21 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 23:23:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:23:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:23:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:23:24 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:23:24 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:23:25 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691623390.055694, c43b9b78-3237-4cb0-be8a-0b3ec6e53aba => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:23:25 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] VM Stopped (Lifecycle Event)
Aug 09 23:23:25 user nova-compute[72409]: DEBUG nova.compute.manager [None req-ab0140df-94db-4bd3-861d-95e65758fda9 None None] [instance: c43b9b78-3237-4cb0-be8a-0b3ec6e53aba] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:23:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:23:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:23:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:23:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:23:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:23:25 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:23:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:23:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:23:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:23:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:23:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:23:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:23:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:23:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:23:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:24:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:24:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:24:03 user nova-compute[72409]: DEBUG nova.compute.manager [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:24:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:24:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:24:03 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:24:03 user nova-compute[72409]: INFO nova.compute.claims [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Claim successful on node user
Aug 09 23:24:04 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:24:04 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:24:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG nova.policy [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '404739e50bd042d29d060fb39c1f8c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5148973bc704627aeccf788e9ac4412', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:24:04 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Creating image(s)
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "/opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "/opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "/opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk 1073741824" returned: 0 in 0.049s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Checking if we can resize image /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:24:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Successfully created port: 3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Cannot resize image /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG nova.objects.instance [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'migration_context' on Instance uuid 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Ensure instance console log exists: /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG nova.network.neutron [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Successfully updated port: 3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquired lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG nova.network.neutron [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG nova.compute.manager [req-b67d3a52-4144-41ec-aa65-7000cb173206 req-de51d3d5-844a-44b3-bb0d-2c599dea2ca2 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Received event network-changed-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG nova.compute.manager [req-b67d3a52-4144-41ec-aa65-7000cb173206 req-de51d3d5-844a-44b3-bb0d-2c599dea2ca2 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Refreshing instance network info cache due to event network-changed-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b67d3a52-4144-41ec-aa65-7000cb173206 req-de51d3d5-844a-44b3-bb0d-2c599dea2ca2 service nova] Acquiring lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:24:05 user nova-compute[72409]: DEBUG nova.network.neutron [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.network.neutron [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updating instance_info_cache with network_info: [{"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Releasing lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.compute.manager [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Instance network_info: |[{"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b67d3a52-4144-41ec-aa65-7000cb173206 req-de51d3d5-844a-44b3-bb0d-2c599dea2ca2 service nova] Acquired lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.network.neutron [req-b67d3a52-4144-41ec-aa65-7000cb173206 req-de51d3d5-844a-44b3-bb0d-2c599dea2ca2 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Refreshing network info cache for port 3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Start _get_guest_xml network_info=[{"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:24:06 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:24:06 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1795428698',display_name='tempest-AttachVolumeTestJSON-server-1795428698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1795428698',id=46,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJGQxS9qJMEdl0v0V9hLbHqwvTMoGTuVigcy1YJZOWxq4upJcZn/ZJN3av1U8GHkQR7t5CaJmZIod8f745tDRsq6ILtw5vRhKz6nVou8xuD+S1TwxENdNc5YSKMD3HyhQ==',key_name='tempest-keypair-77044362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5148973bc704627aeccf788e9ac4412',ramdisk_id='',reservation_id='r-dk2r0dek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1885013657',owner_user_name='tempest-AttachVolumeTestJSON-1885013657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='404739e50bd042d29d060fb39c1f8c4a',uuid=146cb45e-0a4b-4556-90ba-c63ba2a5e38f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converting VIF {"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:f4:73,bridge_name='br-int',has_traffic_filtering=True,id=3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0cc141-c3') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.objects.instance [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'pci_devices' on Instance uuid 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:24:06 user nova-compute[72409]:   <uuid>146cb45e-0a4b-4556-90ba-c63ba2a5e38f</uuid>
Aug 09 23:24:06 user nova-compute[72409]:   <name>instance-0000002e</name>
Aug 09 23:24:06 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:24:06 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:24:06 user nova-compute[72409]:   <metadata>
Aug 09 23:24:06 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:24:06 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:24:06 user nova-compute[72409]:       <nova:name>tempest-AttachVolumeTestJSON-server-1795428698</nova:name>
Aug 09 23:24:06 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:24:06</nova:creationTime>
Aug 09 23:24:06 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:24:06 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:24:06 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:24:06 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:24:06 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:24:06 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:24:06 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:24:06 user nova-compute[72409]:       <nova:owner>
Aug 09 23:24:06 user nova-compute[72409]:         <nova:user uuid="404739e50bd042d29d060fb39c1f8c4a">tempest-AttachVolumeTestJSON-1885013657-project-member</nova:user>
Aug 09 23:24:06 user nova-compute[72409]:         <nova:project uuid="b5148973bc704627aeccf788e9ac4412">tempest-AttachVolumeTestJSON-1885013657</nova:project>
Aug 09 23:24:06 user nova-compute[72409]:       </nova:owner>
Aug 09 23:24:06 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:24:06 user nova-compute[72409]:       <nova:ports>
Aug 09 23:24:06 user nova-compute[72409]:         <nova:port uuid="3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e">
Aug 09 23:24:06 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 23:24:06 user nova-compute[72409]:         </nova:port>
Aug 09 23:24:06 user nova-compute[72409]:       </nova:ports>
Aug 09 23:24:06 user nova-compute[72409]:     </nova:instance>
Aug 09 23:24:06 user nova-compute[72409]:   </metadata>
Aug 09 23:24:06 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:24:06 user nova-compute[72409]:     <system>
Aug 09 23:24:06 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:24:06 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:24:06 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:24:06 user nova-compute[72409]:       <entry name="serial">146cb45e-0a4b-4556-90ba-c63ba2a5e38f</entry>
Aug 09 23:24:06 user nova-compute[72409]:       <entry name="uuid">146cb45e-0a4b-4556-90ba-c63ba2a5e38f</entry>
Aug 09 23:24:06 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:24:06 user nova-compute[72409]:     </system>
Aug 09 23:24:06 user nova-compute[72409]:   </sysinfo>
Aug 09 23:24:06 user nova-compute[72409]:   <os>
Aug 09 23:24:06 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:24:06 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:24:06 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:24:06 user nova-compute[72409]:   </os>
Aug 09 23:24:06 user nova-compute[72409]:   <features>
Aug 09 23:24:06 user nova-compute[72409]:     <acpi/>
Aug 09 23:24:06 user nova-compute[72409]:     <apic/>
Aug 09 23:24:06 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:24:06 user nova-compute[72409]:   </features>
Aug 09 23:24:06 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:24:06 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:24:06 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:24:06 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:24:06 user nova-compute[72409]:   </clock>
Aug 09 23:24:06 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:24:06 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:24:06 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:24:06 user nova-compute[72409]:   </cpu>
Aug 09 23:24:06 user nova-compute[72409]:   <devices>
Aug 09 23:24:06 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:24:06 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:24:06 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk"/>
Aug 09 23:24:06 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:24:06 user nova-compute[72409]:     </disk>
Aug 09 23:24:06 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:24:06 user nova-compute[72409]:       <mac address="fa:16:3e:55:f4:73"/>
Aug 09 23:24:06 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:24:06 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:24:06 user nova-compute[72409]:       <target dev="tap3b0cc141-c3"/>
Aug 09 23:24:06 user nova-compute[72409]:     </interface>
Aug 09 23:24:06 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:24:06 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/console.log" append="off"/>
Aug 09 23:24:06 user nova-compute[72409]:     </serial>
Aug 09 23:24:06 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:24:06 user nova-compute[72409]:     <video>
Aug 09 23:24:06 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:24:06 user nova-compute[72409]:     </video>
Aug 09 23:24:06 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:24:06 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:24:06 user nova-compute[72409]:     </rng>
Aug 09 23:24:06 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:24:06 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:24:06 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:24:06 user nova-compute[72409]:     </memballoon>
Aug 09 23:24:06 user nova-compute[72409]:   </devices>
Aug 09 23:24:06 user nova-compute[72409]: </domain>
Aug 09 23:24:06 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1795428698',display_name='tempest-AttachVolumeTestJSON-server-1795428698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1795428698',id=46,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJGQxS9qJMEdl0v0V9hLbHqwvTMoGTuVigcy1YJZOWxq4upJcZn/ZJN3av1U8GHkQR7t5CaJmZIod8f745tDRsq6ILtw5vRhKz6nVou8xuD+S1TwxENdNc5YSKMD3HyhQ==',key_name='tempest-keypair-77044362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5148973bc704627aeccf788e9ac4412',ramdisk_id='',reservation_id='r-dk2r0dek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1885013657',owner_user_name='tempest-AttachVolumeTestJSON-1885013657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='404739e50bd042d29d060fb39c1f8c4a',uuid=146cb45e-0a4b-4556-90ba-c63ba2a5e38f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converting VIF {"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:f4:73,bridge_name='br-int',has_traffic_filtering=True,id=3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0cc141-c3') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG os_vif [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:f4:73,bridge_name='br-int',has_traffic_filtering=True,id=3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0cc141-c3') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b0cc141-c3, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b0cc141-c3, col_values=(('external_ids', {'iface-id': '3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:f4:73', 'vm-uuid': '146cb45e-0a4b-4556-90ba-c63ba2a5e38f'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:06 user nova-compute[72409]: INFO os_vif [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:f4:73,bridge_name='br-int',has_traffic_filtering=True,id=3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0cc141-c3')
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No VIF found with MAC fa:16:3e:55:f4:73, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.network.neutron [req-b67d3a52-4144-41ec-aa65-7000cb173206 req-de51d3d5-844a-44b3-bb0d-2c599dea2ca2 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updated VIF entry in instance network info cache for port 3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG nova.network.neutron [req-b67d3a52-4144-41ec-aa65-7000cb173206 req-de51d3d5-844a-44b3-bb0d-2c599dea2ca2 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updating instance_info_cache with network_info: [{"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:24:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b67d3a52-4144-41ec-aa65-7000cb173206 req-de51d3d5-844a-44b3-bb0d-2c599dea2ca2 service nova] Releasing lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:24:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:07 user nova-compute[72409]: DEBUG nova.compute.manager [req-b0b46b64-35f4-4cb9-8d4f-7922ef7b06bf req-d04bd422-87d6-4ca3-b5b5-529452e5f8c1 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Received event network-vif-plugged-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:24:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b0b46b64-35f4-4cb9-8d4f-7922ef7b06bf req-d04bd422-87d6-4ca3-b5b5-529452e5f8c1 service nova] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:24:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b0b46b64-35f4-4cb9-8d4f-7922ef7b06bf req-d04bd422-87d6-4ca3-b5b5-529452e5f8c1 service nova] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:24:07 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b0b46b64-35f4-4cb9-8d4f-7922ef7b06bf req-d04bd422-87d6-4ca3-b5b5-529452e5f8c1 service nova] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:24:07 user nova-compute[72409]: DEBUG nova.compute.manager [req-b0b46b64-35f4-4cb9-8d4f-7922ef7b06bf req-d04bd422-87d6-4ca3-b5b5-529452e5f8c1 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] No waiting events found dispatching network-vif-plugged-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:24:07 user nova-compute[72409]: WARNING nova.compute.manager [req-b0b46b64-35f4-4cb9-8d4f-7922ef7b06bf req-d04bd422-87d6-4ca3-b5b5-529452e5f8c1 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Received unexpected event network-vif-plugged-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e for instance with vm_state building and task_state spawning.
Aug 09 23:24:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623449.6977062, 146cb45e-0a4b-4556-90ba-c63ba2a5e38f => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:24:09 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] VM Resumed (Lifecycle Event)
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:24:09 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Instance spawned successfully.
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:24:09 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623449.7019868, 146cb45e-0a4b-4556-90ba-c63ba2a5e38f => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:24:09 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] VM Started (Lifecycle Event)
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:24:09 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:24:09 user nova-compute[72409]: INFO nova.compute.manager [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Took 5.41 seconds to spawn the instance on the hypervisor.
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.compute.manager [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:24:09 user nova-compute[72409]: INFO nova.compute.manager [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Took 5.99 seconds to build instance.
Aug 09 23:24:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-24f6d12c-f7b4-4eee-aa8d-a8db222a4306 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.091s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-1153d24c-a27a-4683-981c-89ac8d923586 req-0342bce7-f346-47ed-ae3a-18f404343d8c service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Received event network-vif-plugged-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1153d24c-a27a-4683-981c-89ac8d923586 req-0342bce7-f346-47ed-ae3a-18f404343d8c service nova] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1153d24c-a27a-4683-981c-89ac8d923586 req-0342bce7-f346-47ed-ae3a-18f404343d8c service nova] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-1153d24c-a27a-4683-981c-89ac8d923586 req-0342bce7-f346-47ed-ae3a-18f404343d8c service nova] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:24:09 user nova-compute[72409]: DEBUG nova.compute.manager [req-1153d24c-a27a-4683-981c-89ac8d923586 req-0342bce7-f346-47ed-ae3a-18f404343d8c service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] No waiting events found dispatching network-vif-plugged-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:24:09 user nova-compute[72409]: WARNING nova.compute.manager [req-1153d24c-a27a-4683-981c-89ac8d923586 req-0342bce7-f346-47ed-ae3a-18f404343d8c service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Received unexpected event network-vif-plugged-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e for instance with vm_state active and task_state None.
Aug 09 23:24:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:24:15 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:24:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:24:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:24:15 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:24:15 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:24:15 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:24:16 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:24:16 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:24:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=25.344776153564453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:24:16 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:24:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:24:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:24:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:24:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:24:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:24:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:24:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:22 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:24:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:24:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:24:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:24:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:24:22 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:24:22 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:24:23 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updating instance_info_cache with network_info: [{"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:24:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:24:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:24:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:24:24 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:24:24 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:24:25 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:24:25 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:24:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:24:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:46 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:24:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:25:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:25:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:25:17 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:25:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:17 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:25:17 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:25:17 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:25:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:18 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:25:18 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:25:18 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:25:18 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=25.315383911132812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:25:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:18 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:25:18 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:25:18 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:25:18 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:25:18 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:25:18 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:25:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:25:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:25:22 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:25:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:25:22 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:25:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:25:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:25:23 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:25:23 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:25:23 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updating instance_info_cache with network_info: [{"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:25:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:25:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:25:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:25:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:26 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:25:26 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:25:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:25:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:25:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:25:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "63087b74-63f6-40da-ae2b-62e170fafa9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:25:38 user nova-compute[72409]: INFO nova.compute.claims [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Claim successful on node user
Aug 09 23:25:38 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:25:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:25:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:25:38 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Creating image(s)
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "/opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "/opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "/opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG nova.policy [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93d18bba24904e29a7a98d0d155f5d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9c8dbfa42314aea94cee5b566aee9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk 1073741824" returned: 0 in 0.048s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:25:38 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:25:39 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:25:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:25:39 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Cannot resize image /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:25:39 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lazy-loading 'migration_context' on Instance uuid 63087b74-63f6-40da-ae2b-62e170fafa9c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:25:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:25:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Ensure instance console log exists: /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:25:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:25:39 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Successfully created port: f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Successfully updated port: f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquired lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.compute.manager [req-a5836736-851c-4416-b914-784885374498 req-3022e074-5b3f-4366-973f-5479b62dcc66 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Received event network-changed-f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.compute.manager [req-a5836736-851c-4416-b914-784885374498 req-3022e074-5b3f-4366-973f-5479b62dcc66 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Refreshing instance network info cache due to event network-changed-f5354856-2be8-4f87-9d6c-5c5f1d46eadd. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a5836736-851c-4416-b914-784885374498 req-3022e074-5b3f-4366-973f-5479b62dcc66 service nova] Acquiring lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.network.neutron [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Updating instance_info_cache with network_info: [{"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Releasing lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Instance network_info: |[{"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a5836736-851c-4416-b914-784885374498 req-3022e074-5b3f-4366-973f-5479b62dcc66 service nova] Acquired lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.network.neutron [req-a5836736-851c-4416-b914-784885374498 req-3022e074-5b3f-4366-973f-5479b62dcc66 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Refreshing network info cache for port f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Start _get_guest_xml network_info=[{"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:25:40 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:25:40 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2006621599',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2006621599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2006621',id=47,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpoyaPFhvfi+fOIdkH4PNwDQsVO0AradEwnfN9CYvWahgunmudp/+bujIQeDeilmoeXZR3Ouq1jyXY0/LXWHi166Q5zqaI+c8vNVvlbaH6nTj3BeqAJaa/AK8WSEu3XPA==',key_name='tempest-keypair-559995405',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9c8dbfa42314aea94cee5b566aee9bd',ramdisk_id='',reservation_id='r-03wp9wt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1460686714',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:25:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93d18bba24904e29a7a98d0d155f5d3a',uuid=63087b74-63f6-40da-ae2b-62e170fafa9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Converting VIF {"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:a4:3d,bridge_name='br-int',has_traffic_filtering=True,id=f5354856-2be8-4f87-9d6c-5c5f1d46eadd,network=Network(41245f9a-8ae7-475f-8134-a0eaf974c087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5354856-2b') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.objects.instance [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lazy-loading 'pci_devices' on Instance uuid 63087b74-63f6-40da-ae2b-62e170fafa9c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:25:40 user nova-compute[72409]:   <uuid>63087b74-63f6-40da-ae2b-62e170fafa9c</uuid>
Aug 09 23:25:40 user nova-compute[72409]:   <name>instance-0000002f</name>
Aug 09 23:25:40 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:25:40 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:25:40 user nova-compute[72409]:   <metadata>
Aug 09 23:25:40 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:25:40 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:25:40 user nova-compute[72409]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2006621599</nova:name>
Aug 09 23:25:40 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:25:40</nova:creationTime>
Aug 09 23:25:40 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:25:40 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:25:40 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:25:40 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:25:40 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:25:40 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:25:40 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:25:40 user nova-compute[72409]:       <nova:owner>
Aug 09 23:25:40 user nova-compute[72409]:         <nova:user uuid="93d18bba24904e29a7a98d0d155f5d3a">tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member</nova:user>
Aug 09 23:25:40 user nova-compute[72409]:         <nova:project uuid="b9c8dbfa42314aea94cee5b566aee9bd">tempest-TestServerVolumeAttachScenarioOldVersion-1460686714</nova:project>
Aug 09 23:25:40 user nova-compute[72409]:       </nova:owner>
Aug 09 23:25:40 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:25:40 user nova-compute[72409]:       <nova:ports>
Aug 09 23:25:40 user nova-compute[72409]:         <nova:port uuid="f5354856-2be8-4f87-9d6c-5c5f1d46eadd">
Aug 09 23:25:40 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 23:25:40 user nova-compute[72409]:         </nova:port>
Aug 09 23:25:40 user nova-compute[72409]:       </nova:ports>
Aug 09 23:25:40 user nova-compute[72409]:     </nova:instance>
Aug 09 23:25:40 user nova-compute[72409]:   </metadata>
Aug 09 23:25:40 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:25:40 user nova-compute[72409]:     <system>
Aug 09 23:25:40 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:25:40 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:25:40 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:25:40 user nova-compute[72409]:       <entry name="serial">63087b74-63f6-40da-ae2b-62e170fafa9c</entry>
Aug 09 23:25:40 user nova-compute[72409]:       <entry name="uuid">63087b74-63f6-40da-ae2b-62e170fafa9c</entry>
Aug 09 23:25:40 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:25:40 user nova-compute[72409]:     </system>
Aug 09 23:25:40 user nova-compute[72409]:   </sysinfo>
Aug 09 23:25:40 user nova-compute[72409]:   <os>
Aug 09 23:25:40 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:25:40 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:25:40 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:25:40 user nova-compute[72409]:   </os>
Aug 09 23:25:40 user nova-compute[72409]:   <features>
Aug 09 23:25:40 user nova-compute[72409]:     <acpi/>
Aug 09 23:25:40 user nova-compute[72409]:     <apic/>
Aug 09 23:25:40 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:25:40 user nova-compute[72409]:   </features>
Aug 09 23:25:40 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:25:40 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:25:40 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:25:40 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:25:40 user nova-compute[72409]:   </clock>
Aug 09 23:25:40 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:25:40 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:25:40 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:25:40 user nova-compute[72409]:   </cpu>
Aug 09 23:25:40 user nova-compute[72409]:   <devices>
Aug 09 23:25:40 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:25:40 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:25:40 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk"/>
Aug 09 23:25:40 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:25:40 user nova-compute[72409]:     </disk>
Aug 09 23:25:40 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:25:40 user nova-compute[72409]:       <mac address="fa:16:3e:42:a4:3d"/>
Aug 09 23:25:40 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:25:40 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:25:40 user nova-compute[72409]:       <target dev="tapf5354856-2b"/>
Aug 09 23:25:40 user nova-compute[72409]:     </interface>
Aug 09 23:25:40 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:25:40 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/console.log" append="off"/>
Aug 09 23:25:40 user nova-compute[72409]:     </serial>
Aug 09 23:25:40 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:25:40 user nova-compute[72409]:     <video>
Aug 09 23:25:40 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:25:40 user nova-compute[72409]:     </video>
Aug 09 23:25:40 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:25:40 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:25:40 user nova-compute[72409]:     </rng>
Aug 09 23:25:40 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:25:40 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:25:40 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:25:40 user nova-compute[72409]:     </memballoon>
Aug 09 23:25:40 user nova-compute[72409]:   </devices>
Aug 09 23:25:40 user nova-compute[72409]: </domain>
Aug 09 23:25:40 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2006621599',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2006621599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2006621',id=47,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpoyaPFhvfi+fOIdkH4PNwDQsVO0AradEwnfN9CYvWahgunmudp/+bujIQeDeilmoeXZR3Ouq1jyXY0/LXWHi166Q5zqaI+c8vNVvlbaH6nTj3BeqAJaa/AK8WSEu3XPA==',key_name='tempest-keypair-559995405',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9c8dbfa42314aea94cee5b566aee9bd',ramdisk_id='',reservation_id='r-03wp9wt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1460686714',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:25:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93d18bba24904e29a7a98d0d155f5d3a',uuid=63087b74-63f6-40da-ae2b-62e170fafa9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Converting VIF {"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:a4:3d,bridge_name='br-int',has_traffic_filtering=True,id=f5354856-2be8-4f87-9d6c-5c5f1d46eadd,network=Network(41245f9a-8ae7-475f-8134-a0eaf974c087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5354856-2b') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG os_vif [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:a4:3d,bridge_name='br-int',has_traffic_filtering=True,id=f5354856-2be8-4f87-9d6c-5c5f1d46eadd,network=Network(41245f9a-8ae7-475f-8134-a0eaf974c087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5354856-2b') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5354856-2b, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5354856-2b, col_values=(('external_ids', {'iface-id': 'f5354856-2be8-4f87-9d6c-5c5f1d46eadd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:a4:3d', 'vm-uuid': '63087b74-63f6-40da-ae2b-62e170fafa9c'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:40 user nova-compute[72409]: INFO os_vif [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:a4:3d,bridge_name='br-int',has_traffic_filtering=True,id=f5354856-2be8-4f87-9d6c-5c5f1d46eadd,network=Network(41245f9a-8ae7-475f-8134-a0eaf974c087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5354856-2b')
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] No VIF found with MAC fa:16:3e:42:a4:3d, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Verify base images {{(pid=72409) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Image id 1f9d9956-e987-40f0-9bbf-df1fe47ca751 yields fingerprint 258aaa65927ef7cee1bfa6c49848a769eed3ea4e {{(pid=72409) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 23:25:40 user nova-compute[72409]: INFO nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] image 1f9d9956-e987-40f0-9bbf-df1fe47ca751 at (/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e): checking
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] image 1f9d9956-e987-40f0-9bbf-df1fe47ca751 at (/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e): image is in use {{(pid=72409) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72409) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] 63087b74-63f6-40da-ae2b-62e170fafa9c is a valid instance name {{(pid=72409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] 63087b74-63f6-40da-ae2b-62e170fafa9c has a disk file {{(pid=72409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 23:25:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:25:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 63087b74-63f6-40da-ae2b-62e170fafa9c is backed by 258aaa65927ef7cee1bfa6c49848a769eed3ea4e {{(pid=72409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 23:25:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] 146cb45e-0a4b-4556-90ba-c63ba2a5e38f is a valid instance name {{(pid=72409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 23:25:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] 146cb45e-0a4b-4556-90ba-c63ba2a5e38f has a disk file {{(pid=72409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 23:25:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:41 user nova-compute[72409]: DEBUG nova.network.neutron [req-a5836736-851c-4416-b914-784885374498 req-3022e074-5b3f-4366-973f-5479b62dcc66 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Updated VIF entry in instance network info cache for port f5354856-2be8-4f87-9d6c-5c5f1d46eadd. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:25:41 user nova-compute[72409]: DEBUG nova.network.neutron [req-a5836736-851c-4416-b914-784885374498 req-3022e074-5b3f-4366-973f-5479b62dcc66 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Updating instance_info_cache with network_info: [{"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:25:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a5836736-851c-4416-b914-784885374498 req-3022e074-5b3f-4366-973f-5479b62dcc66 service nova] Releasing lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:25:41 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:25:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f is backed by 258aaa65927ef7cee1bfa6c49848a769eed3ea4e {{(pid=72409) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 23:25:41 user nova-compute[72409]: WARNING nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Unknown base file: /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2
Aug 09 23:25:41 user nova-compute[72409]: WARNING nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab
Aug 09 23:25:41 user nova-compute[72409]: WARNING nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4
Aug 09 23:25:41 user nova-compute[72409]: WARNING nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7
Aug 09 23:25:41 user nova-compute[72409]: WARNING nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a
Aug 09 23:25:41 user nova-compute[72409]: WARNING nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620
Aug 09 23:25:41 user nova-compute[72409]: WARNING nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21
Aug 09 23:25:41 user nova-compute[72409]: WARNING nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Unknown base file: /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413
Aug 09 23:25:41 user nova-compute[72409]: INFO nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Active base files: /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e
Aug 09 23:25:41 user nova-compute[72409]: INFO nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Removable base files: /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2 /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4 /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7 /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620 /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21 /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413
Aug 09 23:25:41 user nova-compute[72409]: INFO nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/59076043f652cc9aea7a1d4d30570edbc51128e2
Aug 09 23:25:41 user nova-compute[72409]: INFO nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8123f34a0823bcf017f41195ac4d44ccb2c515ab
Aug 09 23:25:41 user nova-compute[72409]: INFO nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8933b5dc43db32ebaa20789efc5feb98ad9976a4
Aug 09 23:25:41 user nova-compute[72409]: INFO nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7977736307184a100b6a8584762f6eb9f96557b7
Aug 09 23:25:41 user nova-compute[72409]: INFO nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c9b41a037b00a0760715210d453edbe11519921a
Aug 09 23:25:41 user nova-compute[72409]: INFO nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c69cb36f421ac9628efd7eb73d9b24d9da0f0620
Aug 09 23:25:41 user nova-compute[72409]: INFO nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fd0dfdbe4d214ee94f51d806bb53b38fd7e36a21
Aug 09 23:25:41 user nova-compute[72409]: INFO nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/40817a5d57b931ef7a9533f4551f8517b4bec413
Aug 09 23:25:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Verification complete {{(pid=72409) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 09 23:25:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Verify swap images {{(pid=72409) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 09 23:25:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.imagecache [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Verify ephemeral images {{(pid=72409) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 09 23:25:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-6a8b93f7-db74-4445-9f31-bd5e7ea90128 req-42d26fab-3de7-41ab-a034-c25ebd0d96b8 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Received event network-vif-plugged-f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:25:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a8b93f7-db74-4445-9f31-bd5e7ea90128 req-42d26fab-3de7-41ab-a034-c25ebd0d96b8 service nova] Acquiring lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a8b93f7-db74-4445-9f31-bd5e7ea90128 req-42d26fab-3de7-41ab-a034-c25ebd0d96b8 service nova] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6a8b93f7-db74-4445-9f31-bd5e7ea90128 req-42d26fab-3de7-41ab-a034-c25ebd0d96b8 service nova] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:25:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-6a8b93f7-db74-4445-9f31-bd5e7ea90128 req-42d26fab-3de7-41ab-a034-c25ebd0d96b8 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] No waiting events found dispatching network-vif-plugged-f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:25:42 user nova-compute[72409]: WARNING nova.compute.manager [req-6a8b93f7-db74-4445-9f31-bd5e7ea90128 req-42d26fab-3de7-41ab-a034-c25ebd0d96b8 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Received unexpected event network-vif-plugged-f5354856-2be8-4f87-9d6c-5c5f1d46eadd for instance with vm_state building and task_state spawning.
Aug 09 23:25:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623544.5199103, 63087b74-63f6-40da-ae2b-62e170fafa9c => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:25:44 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] VM Resumed (Lifecycle Event)
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:25:44 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Instance spawned successfully.
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:25:44 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623544.5249565, 63087b74-63f6-40da-ae2b-62e170fafa9c => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:25:44 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] VM Started (Lifecycle Event)
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-b119182b-c3e2-47f1-9d45-c1f81abca48c req-5d59008c-1d17-4f2d-8c98-abdad7b311c5 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Received event network-vif-plugged-f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b119182b-c3e2-47f1-9d45-c1f81abca48c req-5d59008c-1d17-4f2d-8c98-abdad7b311c5 service nova] Acquiring lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b119182b-c3e2-47f1-9d45-c1f81abca48c req-5d59008c-1d17-4f2d-8c98-abdad7b311c5 service nova] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b119182b-c3e2-47f1-9d45-c1f81abca48c req-5d59008c-1d17-4f2d-8c98-abdad7b311c5 service nova] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-b119182b-c3e2-47f1-9d45-c1f81abca48c req-5d59008c-1d17-4f2d-8c98-abdad7b311c5 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] No waiting events found dispatching network-vif-plugged-f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:25:44 user nova-compute[72409]: WARNING nova.compute.manager [req-b119182b-c3e2-47f1-9d45-c1f81abca48c req-5d59008c-1d17-4f2d-8c98-abdad7b311c5 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Received unexpected event network-vif-plugged-f5354856-2be8-4f87-9d6c-5c5f1d46eadd for instance with vm_state building and task_state spawning.
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:25:44 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:25:44 user nova-compute[72409]: INFO nova.compute.manager [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 09 23:25:44 user nova-compute[72409]: DEBUG nova.compute.manager [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:25:44 user nova-compute[72409]: INFO nova.compute.manager [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Took 6.57 seconds to build instance.
Aug 09 23:25:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-a1863731-57cc-4c69-be36-767d8e1d58f5 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.661s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:25:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-11271de2-2926-4587-affe-50b755a818ab req-8afaed22-583c-40ba-a02d-ce7597a830c3 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Received event network-changed-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:25:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-11271de2-2926-4587-affe-50b755a818ab req-8afaed22-583c-40ba-a02d-ce7597a830c3 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Refreshing instance network info cache due to event network-changed-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:25:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-11271de2-2926-4587-affe-50b755a818ab req-8afaed22-583c-40ba-a02d-ce7597a830c3 service nova] Acquiring lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:25:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-11271de2-2926-4587-affe-50b755a818ab req-8afaed22-583c-40ba-a02d-ce7597a830c3 service nova] Acquired lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:25:54 user nova-compute[72409]: DEBUG nova.network.neutron [req-11271de2-2926-4587-affe-50b755a818ab req-8afaed22-583c-40ba-a02d-ce7597a830c3 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Refreshing network info cache for port 3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:25:55 user nova-compute[72409]: DEBUG nova.network.neutron [req-11271de2-2926-4587-affe-50b755a818ab req-8afaed22-583c-40ba-a02d-ce7597a830c3 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updated VIF entry in instance network info cache for port 3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:25:55 user nova-compute[72409]: DEBUG nova.network.neutron [req-11271de2-2926-4587-affe-50b755a818ab req-8afaed22-583c-40ba-a02d-ce7597a830c3 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updating instance_info_cache with network_info: [{"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:25:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-11271de2-2926-4587-affe-50b755a818ab req-8afaed22-583c-40ba-a02d-ce7597a830c3 service nova] Releasing lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:25:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:25:58 user nova-compute[72409]: INFO nova.compute.manager [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Attaching volume 249417d4-8304-4c80-bf6a-d7fd3fe8ffbc to /dev/vdb
Aug 09 23:25:58 user nova-compute[72409]: DEBUG os_brick.utils [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3989f2-4853-440f-af21-2bc3b6e2c8af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2042273-3e10-486e-87aa-9b06f30e87dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcdbbac-75f2-4abb-9a17-022dfcf2817d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec07c00-d10e-4cc2-a815-4a7d26fb2e7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:25:58 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:25:58 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[524f5aa2-6f65-415f-8b4f-858c37400364]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG os_brick.utils [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:25:58 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updating existing volume attachment record: aefe8043-fbb7-4178-a31d-3e8b51d15b84 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:26:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:06 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:26:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnBKqrMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:26:06 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:26:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:26:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:26:06 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:26:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:26:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:26:06 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:26:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:06 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc114cc2-1ff3-4d38-a8eb-0e4f2ddd5d62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:06 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:26:06 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:06 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[345e9d3f-97d0-43b6-8b99-0d88e791d8db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc] added
Aug 09 23:26:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.091s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[de190e1c-0bf9-484f-bc2e-bfe370eed8fd]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a8b48c-ef99-4c16-ac86-8056e2b4aaa6]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XnBKqrMZ {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XnBKqrMZ" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e52d579-1893-41d7-baf1-db0070b0c837]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XnBKqrMZ'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5370b1e4-aa7f-4af6-953e-f80dd008617f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ee5bb4-b5c1-4578-8872-7f9cbe3b6468]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:26:07 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:26:07 user nova-compute[72409]:  {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:26:07 user nova-compute[72409]: WARNING os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 23:26:07 user nova-compute[72409]: 
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a0f8e0-7d1e-41b7-921a-b7a70b63c4a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc, portal: 172.16.0.220,3260]
Aug 09 23:26:07 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc, portal: 172.16.0.220,3260] successful.
Aug 09 23:26:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0cba63-9d68-4eee-a46f-7be53e567810]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8a6e98-b48a-4bac-b40e-0461af4883ef]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc (non-flash)
Aug 09 23:26:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc (non-flash)
Aug 09 23:26:07 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba09567-114d-4648-a000-bf35a00e7f06]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnBKqrMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:26:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:26:08 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23463613264373137', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:26:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463613264373137', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:26:08 user nova-compute[72409]: DEBUG nova.objects.instance [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:26:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:26:08 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:26:08 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:26:08 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:26:08 user nova-compute[72409]:   <serial>249417d4-8304-4c80-bf6a-d7fd3fe8ffbc</serial>
Aug 09 23:26:08 user nova-compute[72409]: </disk>
Aug 09 23:26:08 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:26:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:26:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:26:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No VIF found with MAC fa:16:3e:55:f4:73, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:26:08 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 23:26:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-b950c3b5-82f9-467b-8095-669cf7d509d9 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.105s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:26:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG nova.objects.instance [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:26:13 user nova-compute[72409]: INFO nova.compute.manager [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Attaching volume d7986f75-63fb-49cf-a66d-4af5ec97f72f to /dev/vdc
Aug 09 23:26:13 user nova-compute[72409]: DEBUG os_brick.utils [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceec6301-4954-4bd3-9038-75ecd461c826]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b251a8-3626-44d4-be56-bb743cdda716]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[332670f4-8e58-4330-969b-de57c723c4c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f717f419-1de8-4e51-88eb-c09ca8eed737]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:26:13 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:26:13 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b760ad-2cd1-4d5d-a59d-1aa3cffebe77]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG os_brick.utils [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:26:13 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updating existing volume attachment record: 966e5091-58a0-476d-a979-d3b245909c83 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:26:14 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:16 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 23:26:16 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] There are 0 instances to clean {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 23:26:19 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:26:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:26:19 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:26:19 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:26:19 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:20 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:26:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:20 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:26:20 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:26:20 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8602MB free_disk=25.276321411132812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:26:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:26:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 63087b74-63f6-40da-ae2b-62e170fafa9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing inventories for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating ProviderTree inventory for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing aggregate associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, aggregates: None {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing trait associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HukBzpmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:26:21 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:26:21 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:26:21 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ef363a-62ca-43f0-91ae-4158c6b751ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:26:21 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af0cd83-7612-4289-b8c4-7978922ad3ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f] added
Aug 09 23:26:21 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[513396f5-73af-4d55-9d3b-a8c894d064f2]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf8732b-cd97-4c82-bd0d-0047ac6abc47]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HukBzpmf {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HukBzpmf" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea5cb14-7e98-40d7-b327-aaa0c748aebb]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HukBzpmf'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[108f4272-6cf9-4ccf-a89c-b2c51f964351]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[392f9420-2739-44ca-9c17-49171aa9c278]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc (non-flash)
Aug 09 23:26:21 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc (non-flash)
Aug 09 23:26:21 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2778ff74-be27-47b0-84e3-0fe9baeb054e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f, portal: 172.16.0.220,3260]
Aug 09 23:26:21 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f, portal: 172.16.0.220,3260] successful.
Aug 09 23:26:21 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fad68a7-3a45-434b-98eb-845a312e10e8]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d2f843-5405-4ea1-a471-6353c6699721]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc (non-flash)
Aug 09 23:26:22 user nova-compute[72409]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f (non-flash)
Aug 09 23:26:22 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc (non-flash)
Aug 09 23:26:22 user nova-compute[72409]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f (non-flash)
Aug 09 23:26:22 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c025dd9-b650-4fca-ae55-a196234ba51f]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:26:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HukBzpmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23431346663666332', 'path': '/dev/sdc'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431346663666332', 'path': '/dev/sdc'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG nova.objects.instance [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:26:23 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:26:23 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:26:23 user nova-compute[72409]:   <target dev="vdc" bus="virtio"/>
Aug 09 23:26:23 user nova-compute[72409]:   <serial>d7986f75-63fb-49cf-a66d-4af5ec97f72f</serial>
Aug 09 23:26:23 user nova-compute[72409]: </disk>
Aug 09 23:26:23 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] No VIF found with MAC fa:16:3e:55:f4:73, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7f904697-de12-4d8b-9c06-91a100d9b29c tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.232s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:26:23 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updating instance_info_cache with network_info: [{"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:26:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-146cb45e-0a4b-4556-90ba-c63ba2a5e38f" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:26:24 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:26:24 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:26:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:26:24 user nova-compute[72409]: INFO nova.compute.manager [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Detaching volume 249417d4-8304-4c80-bf6a-d7fd3fe8ffbc
Aug 09 23:26:24 user nova-compute[72409]: INFO nova.virt.block_device [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Attempting to driver detach volume 249417d4-8304-4c80-bf6a-d7fd3fe8ffbc from mountpoint /dev/vdb
Aug 09 23:26:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Attempting to detach device vdb from instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:26:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:26:24 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:26:24 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:26:24 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:26:24 user nova-compute[72409]:   <serial>249417d4-8304-4c80-bf6a-d7fd3fe8ffbc</serial>
Aug 09 23:26:24 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:26:24 user nova-compute[72409]: </disk>
Aug 09 23:26:24 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:26:24 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully detached device vdb from instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f from the persistent domain config.
Aug 09 23:26:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:26:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:26:24 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:26:24 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:26:24 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:26:24 user nova-compute[72409]:   <serial>249417d4-8304-4c80-bf6a-d7fd3fe8ffbc</serial>
Aug 09 23:26:24 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:26:24 user nova-compute[72409]: </disk>
Aug 09 23:26:24 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691623585.0344038, 146cb45e-0a4b-4556-90ba-c63ba2a5e38f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:26:25 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully detached device vdb from instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f from the live domain config.
Aug 09 23:26:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XnBKqrMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:26:25 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ae31db-8e44-4328-a697-f37fa27c9541]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f39b2a4-3567-49f8-8d65-ab3c7586cff0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc (non-flash)
Aug 09 23:26:25 user nova-compute[72409]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f (non-flash)
Aug 09 23:26:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc (non-flash)
Aug 09 23:26:25 user nova-compute[72409]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f (non-flash)
Aug 09 23:26:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e9c130f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aca7117-298b-47c2-8fee-fa9b24eede09]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7130dbf1-5625-4aec-8daa-53c26695fd28]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7f96de-3dc8-4704-bb33-031836108185]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dd9c51-20a6-47ee-9a89-3aba2d7a3b12]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd689446-af0c-45e8-85a0-96bd3c961ae8]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b3bbdd-c689-4c1e-8434-09a75fe5a83b]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc, portal: 172.16.0.220,3260]
Aug 09 23:26:25 user nova-compute[72409]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc, portal: 172.16.0.220,3260] successful.
Aug 09 23:26:25 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:249417d4-8304-4c80-bf6a-d7fd3fe8ffbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ca2d87-9a4c-4c67-8939-a77261d944c5]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] <== disconnect_volume: return (253ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:26:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:26 user nova-compute[72409]: DEBUG nova.objects.instance [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:26:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-37531d30-7014-4714-be6f-50294ae681d1 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.546s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:26:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:26:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:26:26 user nova-compute[72409]: INFO nova.compute.manager [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Detaching volume d7986f75-63fb-49cf-a66d-4af5ec97f72f
Aug 09 23:26:26 user nova-compute[72409]: INFO nova.virt.block_device [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Attempting to driver detach volume d7986f75-63fb-49cf-a66d-4af5ec97f72f from mountpoint /dev/vdc
Aug 09 23:26:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Attempting to detach device vdc from instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:26:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:26:26 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:26:26 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:26:26 user nova-compute[72409]:   <target dev="vdc" bus="virtio"/>
Aug 09 23:26:26 user nova-compute[72409]:   <serial>d7986f75-63fb-49cf-a66d-4af5ec97f72f</serial>
Aug 09 23:26:26 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 23:26:26 user nova-compute[72409]: </disk>
Aug 09 23:26:26 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:26:26 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully detached device vdc from instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f from the persistent domain config.
Aug 09 23:26:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:26:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:26:26 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:26:26 user nova-compute[72409]:   <source dev="/dev/sdc"/>
Aug 09 23:26:26 user nova-compute[72409]:   <target dev="vdc" bus="virtio"/>
Aug 09 23:26:26 user nova-compute[72409]:   <serial>d7986f75-63fb-49cf-a66d-4af5ec97f72f</serial>
Aug 09 23:26:26 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 23:26:26 user nova-compute[72409]: </disk>
Aug 09 23:26:26 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691623587.3847892, 146cb45e-0a4b-4556-90ba-c63ba2a5e38f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:26:27 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully detached device vdc from instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f from the live domain config.
Aug 09 23:26:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HukBzpmf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:26:27 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec4c25f-4cc4-411b-a367-730d7cd5adaf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a08f197-f23f-42ad-920a-292eeeca3f05]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f (non-flash)
Aug 09 23:26:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f (non-flash)
Aug 09 23:26:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ea20f88b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f'): ({'sdc'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Removing single pathed devices sdc {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa1c102-da97-4b48-8bfe-bbbb97350636]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6766e4-9258-4a0e-a423-6f5150eabb39]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Flushing IO for device /dev/sdc {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd121bbd-1433-42d6-868d-46ef7bcec49e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1683b740-1587-4a88-901b-ab13842b11aa]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] SCSI volumes sdc have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[33501632-06c1-46f6-a234-35745376d8e4]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c1a45d-f726-426c-9f93-7aa18c43ee6f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f, portal: 172.16.0.220,3260]
Aug 09 23:26:27 user nova-compute[72409]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f, portal: 172.16.0.220,3260] successful.
Aug 09 23:26:27 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7986f75-63fb-49cf-a66d-4af5ec97f72f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a247080-18db-418c-ba3f-888a38a4a485]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] <== disconnect_volume: return (258ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:28 user nova-compute[72409]: DEBUG nova.objects.instance [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'flavor' on Instance uuid 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:26:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-9ef07476-19ce-475f-9cf8-ee997aea2b13 tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.567s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:26:28 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:28 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:26:29 user nova-compute[72409]: INFO nova.compute.manager [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Terminating instance
Aug 09 23:26:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG nova.compute.manager [req-f1307d85-327e-416f-893f-737dd90e5743 req-370f5f16-a858-42f1-a36f-22439e908f04 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Received event network-vif-unplugged-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f1307d85-327e-416f-893f-737dd90e5743 req-370f5f16-a858-42f1-a36f-22439e908f04 service nova] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f1307d85-327e-416f-893f-737dd90e5743 req-370f5f16-a858-42f1-a36f-22439e908f04 service nova] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f1307d85-327e-416f-893f-737dd90e5743 req-370f5f16-a858-42f1-a36f-22439e908f04 service nova] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG nova.compute.manager [req-f1307d85-327e-416f-893f-737dd90e5743 req-370f5f16-a858-42f1-a36f-22439e908f04 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] No waiting events found dispatching network-vif-unplugged-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG nova.compute.manager [req-f1307d85-327e-416f-893f-737dd90e5743 req-370f5f16-a858-42f1-a36f-22439e908f04 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Received event network-vif-unplugged-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:30 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Instance destroyed successfully.
Aug 09 23:26:30 user nova-compute[72409]: DEBUG nova.objects.instance [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lazy-loading 'resources' on Instance uuid 146cb45e-0a4b-4556-90ba-c63ba2a5e38f {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:26:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:24:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1795428698',display_name='tempest-AttachVolumeTestJSON-server-1795428698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1795428698',id=46,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJGQxS9qJMEdl0v0V9hLbHqwvTMoGTuVigcy1YJZOWxq4upJcZn/ZJN3av1U8GHkQR7t5CaJmZIod8f745tDRsq6ILtw5vRhKz6nVou8xuD+S1TwxENdNc5YSKMD3HyhQ==',key_name='tempest-keypair-77044362',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:24:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5148973bc704627aeccf788e9ac4412',ramdisk_id='',reservation_id='r-dk2r0dek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885013657',owner_user_name='tempest-AttachVolumeTestJSON-1885013657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:24:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='404739e50bd042d29d060fb39c1f8c4a',uuid=146cb45e-0a4b-4556-90ba-c63ba2a5e38f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:26:30 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converting VIF {"id": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "address": "fa:16:3e:55:f4:73", "network": {"id": "7d012a1a-c36d-41c1-95ad-f1410d77b9ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1619658302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5148973bc704627aeccf788e9ac4412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b0cc141-c3", "ovs_interfaceid": "3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:26:30 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:f4:73,bridge_name='br-int',has_traffic_filtering=True,id=3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0cc141-c3') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:26:30 user nova-compute[72409]: DEBUG os_vif [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:f4:73,bridge_name='br-int',has_traffic_filtering=True,id=3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0cc141-c3') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:26:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b0cc141-c3, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:26:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:26:30 user nova-compute[72409]: INFO os_vif [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:f4:73,bridge_name='br-int',has_traffic_filtering=True,id=3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e,network=Network(7d012a1a-c36d-41c1-95ad-f1410d77b9ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b0cc141-c3')
Aug 09 23:26:30 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Deleting instance files /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f_del
Aug 09 23:26:30 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Deletion of /opt/stack/data/nova/instances/146cb45e-0a4b-4556-90ba-c63ba2a5e38f_del complete
Aug 09 23:26:30 user nova-compute[72409]: INFO nova.compute.manager [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 23:26:30 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:26:30 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:26:30 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:26:31 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:26:31 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Took 0.87 seconds to deallocate network for instance.
Aug 09 23:26:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:26:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:26:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-34330509-08bd-4f02-8c5a-fc75fa31f4e2 req-a3788773-1c9e-4bbc-a2e8-e4e4440db8b7 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Received event network-vif-deleted-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:26:31 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:26:31 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:26:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:26:31 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Deleted allocations for instance 146cb45e-0a4b-4556-90ba-c63ba2a5e38f
Aug 09 23:26:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3068ab17-cdf2-4cae-a8f3-d121a17df02b tempest-AttachVolumeTestJSON-1885013657 tempest-AttachVolumeTestJSON-1885013657-project-member] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.016s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:26:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-4fd0926f-6ac4-403e-a252-0389997e6dd8 req-ee55f442-86e3-4160-b182-7f46d6b990a3 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Received event network-vif-plugged-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:26:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4fd0926f-6ac4-403e-a252-0389997e6dd8 req-ee55f442-86e3-4160-b182-7f46d6b990a3 service nova] Acquiring lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:26:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4fd0926f-6ac4-403e-a252-0389997e6dd8 req-ee55f442-86e3-4160-b182-7f46d6b990a3 service nova] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:26:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4fd0926f-6ac4-403e-a252-0389997e6dd8 req-ee55f442-86e3-4160-b182-7f46d6b990a3 service nova] Lock "146cb45e-0a4b-4556-90ba-c63ba2a5e38f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:26:31 user nova-compute[72409]: DEBUG nova.compute.manager [req-4fd0926f-6ac4-403e-a252-0389997e6dd8 req-ee55f442-86e3-4160-b182-7f46d6b990a3 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] No waiting events found dispatching network-vif-plugged-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:26:31 user nova-compute[72409]: WARNING nova.compute.manager [req-4fd0926f-6ac4-403e-a252-0389997e6dd8 req-ee55f442-86e3-4160-b182-7f46d6b990a3 service nova] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Received unexpected event network-vif-plugged-3b0cc141-c3fb-43b5-b0e9-eb1bb4069b4e for instance with vm_state deleted and task_state None.
Aug 09 23:26:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:26:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:26:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:26:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:26:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:26:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:26:45 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691623590.2264743, 146cb45e-0a4b-4556-90ba-c63ba2a5e38f => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:26:45 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] VM Stopped (Lifecycle Event)
Aug 09 23:26:45 user nova-compute[72409]: DEBUG nova.compute.manager [None req-e7401708-cdd6-4d1e-afa6-84a430d4a07b None None] [instance: 146cb45e-0a4b-4556-90ba-c63ba2a5e38f] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:26:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:26:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:26:53 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:26:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:27:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:27:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:27:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:27:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:27:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:27:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:13 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:27:13 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 63087b74-63f6-40da-ae2b-62e170fafa9c {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:27:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "63087b74-63f6-40da-ae2b-62e170fafa9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:13 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:27:15 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:27:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:27:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:20 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:20 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:27:20 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:21 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:27:21 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:27:21 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=25.302928924560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:27:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:21 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 63087b74-63f6-40da-ae2b-62e170fafa9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:27:21 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:27:21 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:27:21 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:27:21 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:27:21 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:27:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:22 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:27:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:27:24 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:27:24 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:27:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:27:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:27:24 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:27:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:25 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Updating instance_info_cache with network_info: [{"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:27:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:27:25 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:27:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:27:28 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:27:28 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:27:29 user nova-compute[72409]: DEBUG nova.compute.manager [req-6c95da3c-22c1-4c3d-b8d3-3662d42c60ba req-195e920d-42bd-4caa-802e-fa9782b3a3a1 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Received event network-changed-f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:27:29 user nova-compute[72409]: DEBUG nova.compute.manager [req-6c95da3c-22c1-4c3d-b8d3-3662d42c60ba req-195e920d-42bd-4caa-802e-fa9782b3a3a1 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Refreshing instance network info cache due to event network-changed-f5354856-2be8-4f87-9d6c-5c5f1d46eadd. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:27:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6c95da3c-22c1-4c3d-b8d3-3662d42c60ba req-195e920d-42bd-4caa-802e-fa9782b3a3a1 service nova] Acquiring lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:27:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6c95da3c-22c1-4c3d-b8d3-3662d42c60ba req-195e920d-42bd-4caa-802e-fa9782b3a3a1 service nova] Acquired lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:27:29 user nova-compute[72409]: DEBUG nova.network.neutron [req-6c95da3c-22c1-4c3d-b8d3-3662d42c60ba req-195e920d-42bd-4caa-802e-fa9782b3a3a1 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Refreshing network info cache for port f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:27:29 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:27:29 user nova-compute[72409]: DEBUG nova.network.neutron [req-6c95da3c-22c1-4c3d-b8d3-3662d42c60ba req-195e920d-42bd-4caa-802e-fa9782b3a3a1 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Updated VIF entry in instance network info cache for port f5354856-2be8-4f87-9d6c-5c5f1d46eadd. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:27:29 user nova-compute[72409]: DEBUG nova.network.neutron [req-6c95da3c-22c1-4c3d-b8d3-3662d42c60ba req-195e920d-42bd-4caa-802e-fa9782b3a3a1 service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Updating instance_info_cache with network_info: [{"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:27:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-6c95da3c-22c1-4c3d-b8d3-3662d42c60ba req-195e920d-42bd-4caa-802e-fa9782b3a3a1 service nova] Releasing lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:27:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:27:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "63087b74-63f6-40da-ae2b-62e170fafa9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG nova.objects.instance [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lazy-loading 'flavor' on Instance uuid 63087b74-63f6-40da-ae2b-62e170fafa9c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "63087b74-63f6-40da-ae2b-62e170fafa9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:33 user nova-compute[72409]: INFO nova.compute.manager [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Attaching volume 954663ec-0216-4063-8847-8a791291434f to /dev/vdb
Aug 09 23:27:33 user nova-compute[72409]: DEBUG os_brick.utils [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e001e6d6-c753-4475-880b-40f8d73d71ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4d6088-995f-4c7f-b52c-b5293fa3b1b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6426391-93a0-4957-9a98-6d119628be85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[821f8a74-d0d8-45e7-9af7-fc6cf69f4cdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:27:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:27:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:27:34 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:27:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bffd5e-2d6b-4e17-ac6a-9f4e4606b9f7]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:27:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:27:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:27:34 user nova-compute[72409]: DEBUG os_brick.utils [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:27:34 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Updating existing volume attachment record: 23c15b0a-76ee-458d-bd78-7263c42084a9 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:27:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ciZXpgyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:27:42 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:27:42 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:27:42 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[669146b4-aa4f-4957-bdff-cacc4342fc30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:27:42 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f0b180-0e14-45ba-9766-29c9dd2a24ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f] added
Aug 09 23:27:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e040d2c1-6faa-49b1-b20c-effbee07e969]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b2af56-51ef-4ddd-80c5-dbb4a2ee6958]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ciZXpgyH {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ciZXpgyH" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e163bb-d080-4f35-8adc-9926081ded1b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ciZXpgyH'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[120ef23e-6774-4db1-a28a-adfafebf9174]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eb4067-f1ee-4692-84f2-c42d6aa5a555]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:27:42 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:27:42 user nova-compute[72409]:  {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:27:42 user nova-compute[72409]: WARNING os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 23:27:42 user nova-compute[72409]: 
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e2af26-a2a1-4b95-a066-16f3b07de5d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f, portal: 172.16.0.220,3260]
Aug 09 23:27:42 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f, portal: 172.16.0.220,3260] successful.
Aug 09 23:27:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[081b35bb-37ed-4a3d-81a2-09aa5f3c8d67]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[46532c6a-3d86-40fd-8d76-7e92211632b6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f (non-flash)
Aug 09 23:27:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f (non-flash)
Aug 09 23:27:42 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0056bbd5-8366-4c51-ba7a-355225a70a67]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:27:42 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ciZXpgyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:27:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:27:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26431373934313438', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:27:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431373934313438', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:27:43 user nova-compute[72409]: DEBUG nova.objects.instance [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lazy-loading 'flavor' on Instance uuid 63087b74-63f6-40da-ae2b-62e170fafa9c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:27:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:27:43 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:27:43 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:27:43 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:27:43 user nova-compute[72409]:   <serial>954663ec-0216-4063-8847-8a791291434f</serial>
Aug 09 23:27:43 user nova-compute[72409]: </disk>
Aug 09 23:27:43 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:27:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:27:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:27:44 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] No VIF found with MAC fa:16:3e:42:a4:3d, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:27:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d65e7421-b984-4856-9dd8-01efc0c14b2e tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.447s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "63087b74-63f6-40da-ae2b-62e170fafa9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:46 user nova-compute[72409]: INFO nova.compute.manager [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Detaching volume 954663ec-0216-4063-8847-8a791291434f
Aug 09 23:27:46 user nova-compute[72409]: INFO nova.virt.block_device [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Attempting to driver detach volume 954663ec-0216-4063-8847-8a791291434f from mountpoint /dev/vdb
Aug 09 23:27:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Attempting to detach device vdb from instance 63087b74-63f6-40da-ae2b-62e170fafa9c from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:27:46 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:27:46 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:27:46 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:27:46 user nova-compute[72409]:   <serial>954663ec-0216-4063-8847-8a791291434f</serial>
Aug 09 23:27:46 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:27:46 user nova-compute[72409]: </disk>
Aug 09 23:27:46 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:27:46 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Successfully detached device vdb from instance 63087b74-63f6-40da-ae2b-62e170fafa9c from the persistent domain config.
Aug 09 23:27:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63087b74-63f6-40da-ae2b-62e170fafa9c from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:27:46 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:27:46 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:27:46 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:27:46 user nova-compute[72409]:   <serial>954663ec-0216-4063-8847-8a791291434f</serial>
Aug 09 23:27:46 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:27:46 user nova-compute[72409]: </disk>
Aug 09 23:27:46 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691623666.494905, 63087b74-63f6-40da-ae2b-62e170fafa9c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63087b74-63f6-40da-ae2b-62e170fafa9c {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:27:46 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Successfully detached device vdb from instance 63087b74-63f6-40da-ae2b-62e170fafa9c from the live domain config.
Aug 09 23:27:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ciZXpgyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:27:46 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a520cc4-0335-44db-9f96-a737c4c215e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd90cbe-04b8-4a80-a43e-bdc9d7ec0aaa]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f (non-flash)
Aug 09 23:27:46 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f (non-flash)
Aug 09 23:27:46 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e844e7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b51838b-fada-406b-a901-26a611e4cd2e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[649978a7-6a7e-419f-bf50-4baef4c83885]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[291b95cd-4cae-4b2e-8710-828bbdb80bb4]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7e099a-8180-4e9e-b9d5-d37674454ead]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab080fa-2755-48b4-82ec-69564b583a22]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77e8bd9-dfb9-407c-a431-11208eb8ff39]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f, portal: 172.16.0.220,3260]
Aug 09 23:27:46 user nova-compute[72409]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f, portal: 172.16.0.220,3260] successful.
Aug 09 23:27:46 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:954663ec-0216-4063-8847-8a791291434f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31982a7-898c-4f39-9f69-ccfcf1b8ea0c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] <== disconnect_volume: return (265ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:27:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:27:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:47 user nova-compute[72409]: DEBUG nova.objects.instance [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lazy-loading 'flavor' on Instance uuid 63087b74-63f6-40da-ae2b-62e170fafa9c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:27:47 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-46ce64cb-ae26-4f53-be62-74d619f4d514 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.576s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:51 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "7f3d6e45-f630-475b-aa04-216863dc0e26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:53 user nova-compute[72409]: DEBUG nova.compute.manager [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:27:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:53 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:53 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:27:53 user nova-compute[72409]: INFO nova.compute.claims [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Claim successful on node user
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.network.neutron [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:27:54 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.policy [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17d9e59fb7444f06bd3f27c0ecf55cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c2a26aea0b400389c76c17af8ba663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:27:54 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Creating image(s)
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "/opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "/opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.141s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk 1073741824" returned: 0 in 0.052s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.network.neutron [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Successfully created port: baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Cannot resize image /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.objects.instance [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'migration_context' on Instance uuid 7f3d6e45-f630-475b-aa04-216863dc0e26 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Ensure instance console log exists: /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Successfully updated port: baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquired lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-89c0d127-6a4b-49bf-855e-9500eeb9b171 req-8908c6e5-447e-4532-a53e-65ea9e7b5f16 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Received event network-changed-baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.compute.manager [req-89c0d127-6a4b-49bf-855e-9500eeb9b171 req-8908c6e5-447e-4532-a53e-65ea9e7b5f16 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Refreshing instance network info cache due to event network-changed-baad5df1-e132-4651-b8f0-b138b54b93bd. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-89c0d127-6a4b-49bf-855e-9500eeb9b171 req-8908c6e5-447e-4532-a53e-65ea9e7b5f16 service nova] Acquiring lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.network.neutron [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updating instance_info_cache with network_info: [{"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Releasing lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.compute.manager [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Instance network_info: |[{"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-89c0d127-6a4b-49bf-855e-9500eeb9b171 req-8908c6e5-447e-4532-a53e-65ea9e7b5f16 service nova] Acquired lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.network.neutron [req-89c0d127-6a4b-49bf-855e-9500eeb9b171 req-8908c6e5-447e-4532-a53e-65ea9e7b5f16 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Refreshing network info cache for port baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Start _get_guest_xml network_info=[{"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:27:55 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:27:55 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:27:55 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1830493295',display_name='tempest-AttachVolumeNegativeTest-server-1830493295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1830493295',id=48,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGweeJJH+HqeE/VidCu4agwluIy1D4QBbwiSsn5fpawFT/XYPkUVT1O1R4k8KCvOvW6DhpICxfFDGU/LuMOjGvbpu5h6rwtJYonP+5T8kFm4GCLdkZl6a1mrrMgpI9sZ2Q==',key_name='tempest-keypair-1930207951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8c2a26aea0b400389c76c17af8ba663',ramdisk_id='',reservation_id='r-qmks26qv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1895927455',owner_user_name='tempest-AttachVolumeNegativeTest-1895927455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17d9e59fb7444f06bd3f27c0ecf55cec',uuid=7f3d6e45-f630-475b-aa04-216863dc0e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converting VIF {"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:75:8b,bridge_name='br-int',has_traffic_filtering=True,id=baad5df1-e132-4651-b8f0-b138b54b93bd,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaad5df1-e1') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG nova.objects.instance [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f3d6e45-f630-475b-aa04-216863dc0e26 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:27:56 user nova-compute[72409]:   <uuid>7f3d6e45-f630-475b-aa04-216863dc0e26</uuid>
Aug 09 23:27:56 user nova-compute[72409]:   <name>instance-00000030</name>
Aug 09 23:27:56 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:27:56 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:27:56 user nova-compute[72409]:   <metadata>
Aug 09 23:27:56 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:27:56 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:27:56 user nova-compute[72409]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1830493295</nova:name>
Aug 09 23:27:56 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:27:55</nova:creationTime>
Aug 09 23:27:56 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:27:56 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:27:56 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:27:56 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:27:56 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:27:56 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:27:56 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:27:56 user nova-compute[72409]:       <nova:owner>
Aug 09 23:27:56 user nova-compute[72409]:         <nova:user uuid="17d9e59fb7444f06bd3f27c0ecf55cec">tempest-AttachVolumeNegativeTest-1895927455-project-member</nova:user>
Aug 09 23:27:56 user nova-compute[72409]:         <nova:project uuid="f8c2a26aea0b400389c76c17af8ba663">tempest-AttachVolumeNegativeTest-1895927455</nova:project>
Aug 09 23:27:56 user nova-compute[72409]:       </nova:owner>
Aug 09 23:27:56 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:27:56 user nova-compute[72409]:       <nova:ports>
Aug 09 23:27:56 user nova-compute[72409]:         <nova:port uuid="baad5df1-e132-4651-b8f0-b138b54b93bd">
Aug 09 23:27:56 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 23:27:56 user nova-compute[72409]:         </nova:port>
Aug 09 23:27:56 user nova-compute[72409]:       </nova:ports>
Aug 09 23:27:56 user nova-compute[72409]:     </nova:instance>
Aug 09 23:27:56 user nova-compute[72409]:   </metadata>
Aug 09 23:27:56 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:27:56 user nova-compute[72409]:     <system>
Aug 09 23:27:56 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:27:56 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:27:56 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:27:56 user nova-compute[72409]:       <entry name="serial">7f3d6e45-f630-475b-aa04-216863dc0e26</entry>
Aug 09 23:27:56 user nova-compute[72409]:       <entry name="uuid">7f3d6e45-f630-475b-aa04-216863dc0e26</entry>
Aug 09 23:27:56 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:27:56 user nova-compute[72409]:     </system>
Aug 09 23:27:56 user nova-compute[72409]:   </sysinfo>
Aug 09 23:27:56 user nova-compute[72409]:   <os>
Aug 09 23:27:56 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:27:56 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:27:56 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:27:56 user nova-compute[72409]:   </os>
Aug 09 23:27:56 user nova-compute[72409]:   <features>
Aug 09 23:27:56 user nova-compute[72409]:     <acpi/>
Aug 09 23:27:56 user nova-compute[72409]:     <apic/>
Aug 09 23:27:56 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:27:56 user nova-compute[72409]:   </features>
Aug 09 23:27:56 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:27:56 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:27:56 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:27:56 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:27:56 user nova-compute[72409]:   </clock>
Aug 09 23:27:56 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:27:56 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:27:56 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:27:56 user nova-compute[72409]:   </cpu>
Aug 09 23:27:56 user nova-compute[72409]:   <devices>
Aug 09 23:27:56 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:27:56 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:27:56 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk"/>
Aug 09 23:27:56 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:27:56 user nova-compute[72409]:     </disk>
Aug 09 23:27:56 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:27:56 user nova-compute[72409]:       <mac address="fa:16:3e:4d:75:8b"/>
Aug 09 23:27:56 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:27:56 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:27:56 user nova-compute[72409]:       <target dev="tapbaad5df1-e1"/>
Aug 09 23:27:56 user nova-compute[72409]:     </interface>
Aug 09 23:27:56 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:27:56 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/console.log" append="off"/>
Aug 09 23:27:56 user nova-compute[72409]:     </serial>
Aug 09 23:27:56 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:27:56 user nova-compute[72409]:     <video>
Aug 09 23:27:56 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:27:56 user nova-compute[72409]:     </video>
Aug 09 23:27:56 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:27:56 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:27:56 user nova-compute[72409]:     </rng>
Aug 09 23:27:56 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:27:56 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:27:56 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:27:56 user nova-compute[72409]:     </memballoon>
Aug 09 23:27:56 user nova-compute[72409]:   </devices>
Aug 09 23:27:56 user nova-compute[72409]: </domain>
Aug 09 23:27:56 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1830493295',display_name='tempest-AttachVolumeNegativeTest-server-1830493295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1830493295',id=48,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGweeJJH+HqeE/VidCu4agwluIy1D4QBbwiSsn5fpawFT/XYPkUVT1O1R4k8KCvOvW6DhpICxfFDGU/LuMOjGvbpu5h6rwtJYonP+5T8kFm4GCLdkZl6a1mrrMgpI9sZ2Q==',key_name='tempest-keypair-1930207951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8c2a26aea0b400389c76c17af8ba663',ramdisk_id='',reservation_id='r-qmks26qv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1895927455',owner_user_name='tempest-AttachVolumeNegativeTest-1895927455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17d9e59fb7444f06bd3f27c0ecf55cec',uuid=7f3d6e45-f630-475b-aa04-216863dc0e26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converting VIF {"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:75:8b,bridge_name='br-int',has_traffic_filtering=True,id=baad5df1-e132-4651-b8f0-b138b54b93bd,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaad5df1-e1') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG os_vif [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:75:8b,bridge_name='br-int',has_traffic_filtering=True,id=baad5df1-e132-4651-b8f0-b138b54b93bd,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaad5df1-e1') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbaad5df1-e1, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbaad5df1-e1, col_values=(('external_ids', {'iface-id': 'baad5df1-e132-4651-b8f0-b138b54b93bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:75:8b', 'vm-uuid': '7f3d6e45-f630-475b-aa04-216863dc0e26'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:56 user nova-compute[72409]: INFO os_vif [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:75:8b,bridge_name='br-int',has_traffic_filtering=True,id=baad5df1-e132-4651-b8f0-b138b54b93bd,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaad5df1-e1')
Aug 09 23:27:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No VIF found with MAC fa:16:3e:4d:75:8b, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG nova.network.neutron [req-89c0d127-6a4b-49bf-855e-9500eeb9b171 req-8908c6e5-447e-4532-a53e-65ea9e7b5f16 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updated VIF entry in instance network info cache for port baad5df1-e132-4651-b8f0-b138b54b93bd. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG nova.network.neutron [req-89c0d127-6a4b-49bf-855e-9500eeb9b171 req-8908c6e5-447e-4532-a53e-65ea9e7b5f16 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updating instance_info_cache with network_info: [{"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:27:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-89c0d127-6a4b-49bf-855e-9500eeb9b171 req-8908c6e5-447e-4532-a53e-65ea9e7b5f16 service nova] Releasing lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:27:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-3e701dd5-88a0-4d99-b25c-ad4da343a29f req-ab21be70-dee9-4c53-a262-4ef3858fbf08 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Received event network-vif-plugged-baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:27:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3e701dd5-88a0-4d99-b25c-ad4da343a29f req-ab21be70-dee9-4c53-a262-4ef3858fbf08 service nova] Acquiring lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3e701dd5-88a0-4d99-b25c-ad4da343a29f req-ab21be70-dee9-4c53-a262-4ef3858fbf08 service nova] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:57 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3e701dd5-88a0-4d99-b25c-ad4da343a29f req-ab21be70-dee9-4c53-a262-4ef3858fbf08 service nova] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:57 user nova-compute[72409]: DEBUG nova.compute.manager [req-3e701dd5-88a0-4d99-b25c-ad4da343a29f req-ab21be70-dee9-4c53-a262-4ef3858fbf08 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] No waiting events found dispatching network-vif-plugged-baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:27:57 user nova-compute[72409]: WARNING nova.compute.manager [req-3e701dd5-88a0-4d99-b25c-ad4da343a29f req-ab21be70-dee9-4c53-a262-4ef3858fbf08 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Received unexpected event network-vif-plugged-baad5df1-e132-4651-b8f0-b138b54b93bd for instance with vm_state building and task_state spawning.
Aug 09 23:27:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623679.603831, 7f3d6e45-f630-475b-aa04-216863dc0e26 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:27:59 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] VM Resumed (Lifecycle Event)
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:27:59 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Instance spawned successfully.
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:27:59 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623679.6074464, 7f3d6e45-f630-475b-aa04-216863dc0e26 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:27:59 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] VM Started (Lifecycle Event)
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:27:59 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:27:59 user nova-compute[72409]: INFO nova.compute.manager [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Took 5.45 seconds to spawn the instance on the hypervisor.
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.compute.manager [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:27:59 user nova-compute[72409]: INFO nova.compute.manager [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Took 5.97 seconds to build instance.
Aug 09 23:27:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-db27f9d2-8a53-485c-805c-3b6dfc7c0d87 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.065s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-4fe62a42-5953-4f4a-8835-39a495a5f458 req-c662b15b-64e4-47c5-bdff-8b8cc83841da service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Received event network-vif-plugged-baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4fe62a42-5953-4f4a-8835-39a495a5f458 req-c662b15b-64e4-47c5-bdff-8b8cc83841da service nova] Acquiring lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4fe62a42-5953-4f4a-8835-39a495a5f458 req-c662b15b-64e4-47c5-bdff-8b8cc83841da service nova] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4fe62a42-5953-4f4a-8835-39a495a5f458 req-c662b15b-64e4-47c5-bdff-8b8cc83841da service nova] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:27:59 user nova-compute[72409]: DEBUG nova.compute.manager [req-4fe62a42-5953-4f4a-8835-39a495a5f458 req-c662b15b-64e4-47c5-bdff-8b8cc83841da service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] No waiting events found dispatching network-vif-plugged-baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:27:59 user nova-compute[72409]: WARNING nova.compute.manager [req-4fe62a42-5953-4f4a-8835-39a495a5f458 req-c662b15b-64e4-47c5-bdff-8b8cc83841da service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Received unexpected event network-vif-plugged-baad5df1-e132-4651-b8f0-b138b54b93bd for instance with vm_state active and task_state None.
Aug 09 23:28:01 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:11 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:15 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:28:16 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:21 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:28:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:28:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:28:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:28:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:28:21 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:28:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:28:22 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:28:22 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:28:22 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=25.272083282470703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 63087b74-63f6-40da-ae2b-62e170fafa9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7f3d6e45-f630-475b-aa04-216863dc0e26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:28:22 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:28:23 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:28:23 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:28:23 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:28:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:28:26 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 63087b74-63f6-40da-ae2b-62e170fafa9c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Updating instance_info_cache with network_info: [{"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-63087b74-63f6-40da-ae2b-62e170fafa9c" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:28:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:28:28 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:28:28 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:28:29 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:28:31 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:28:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "63087b74-63f6-40da-ae2b-62e170fafa9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:28:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:28:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:28:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:28:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:28:41 user nova-compute[72409]: INFO nova.compute.manager [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Terminating instance
Aug 09 23:28:41 user nova-compute[72409]: DEBUG nova.compute.manager [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:28:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:41 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-0f291658-536c-4b9d-a3ba-eb0ff4caee2d req-8a8c340f-32f4-4399-917f-90c22bd11b6a service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Received event network-vif-unplugged-f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0f291658-536c-4b9d-a3ba-eb0ff4caee2d req-8a8c340f-32f4-4399-917f-90c22bd11b6a service nova] Acquiring lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0f291658-536c-4b9d-a3ba-eb0ff4caee2d req-8a8c340f-32f4-4399-917f-90c22bd11b6a service nova] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0f291658-536c-4b9d-a3ba-eb0ff4caee2d req-8a8c340f-32f4-4399-917f-90c22bd11b6a service nova] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-0f291658-536c-4b9d-a3ba-eb0ff4caee2d req-8a8c340f-32f4-4399-917f-90c22bd11b6a service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] No waiting events found dispatching network-vif-unplugged-f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG nova.compute.manager [req-0f291658-536c-4b9d-a3ba-eb0ff4caee2d req-8a8c340f-32f4-4399-917f-90c22bd11b6a service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Received event network-vif-unplugged-f5354856-2be8-4f87-9d6c-5c5f1d46eadd for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:42 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Instance destroyed successfully.
Aug 09 23:28:42 user nova-compute[72409]: DEBUG nova.objects.instance [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lazy-loading 'resources' on Instance uuid 63087b74-63f6-40da-ae2b-62e170fafa9c {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2006621599',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2006621599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2006621',id=47,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpoyaPFhvfi+fOIdkH4PNwDQsVO0AradEwnfN9CYvWahgunmudp/+bujIQeDeilmoeXZR3Ouq1jyXY0/LXWHi166Q5zqaI+c8vNVvlbaH6nTj3BeqAJaa/AK8WSEu3XPA==',key_name='tempest-keypair-559995405',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:25:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9c8dbfa42314aea94cee5b566aee9bd',ramdisk_id='',reservation_id='r-03wp9wt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1460686714',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93d18bba24904e29a7a98d0d155f5d3a',uuid=63087b74-63f6-40da-ae2b-62e170fafa9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Converting VIF {"id": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "address": "fa:16:3e:42:a4:3d", "network": {"id": "41245f9a-8ae7-475f-8134-a0eaf974c087", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1566520904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9c8dbfa42314aea94cee5b566aee9bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5354856-2b", "ovs_interfaceid": "f5354856-2be8-4f87-9d6c-5c5f1d46eadd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:a4:3d,bridge_name='br-int',has_traffic_filtering=True,id=f5354856-2be8-4f87-9d6c-5c5f1d46eadd,network=Network(41245f9a-8ae7-475f-8134-a0eaf974c087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5354856-2b') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG os_vif [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:a4:3d,bridge_name='br-int',has_traffic_filtering=True,id=f5354856-2be8-4f87-9d6c-5c5f1d46eadd,network=Network(41245f9a-8ae7-475f-8134-a0eaf974c087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5354856-2b') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5354856-2b, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:28:42 user nova-compute[72409]: INFO os_vif [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:a4:3d,bridge_name='br-int',has_traffic_filtering=True,id=f5354856-2be8-4f87-9d6c-5c5f1d46eadd,network=Network(41245f9a-8ae7-475f-8134-a0eaf974c087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5354856-2b')
Aug 09 23:28:42 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Deleting instance files /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c_del
Aug 09 23:28:42 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Deletion of /opt/stack/data/nova/instances/63087b74-63f6-40da-ae2b-62e170fafa9c_del complete
Aug 09 23:28:42 user nova-compute[72409]: INFO nova.compute.manager [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 09 23:28:42 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:28:42 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:28:43 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:28:43 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Took 1.30 seconds to deallocate network for instance.
Aug 09 23:28:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-a3b22c5c-85b4-434e-93c7-3265a7f6b2bd req-81d808cf-454e-4ef7-9c16-d49ab465dc2a service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Received event network-vif-deleted-f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:28:44 user nova-compute[72409]: INFO nova.compute.manager [req-a3b22c5c-85b4-434e-93c7-3265a7f6b2bd req-81d808cf-454e-4ef7-9c16-d49ab465dc2a service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Neutron deleted interface f5354856-2be8-4f87-9d6c-5c5f1d46eadd; detaching it from the instance and deleting it from the info cache
Aug 09 23:28:44 user nova-compute[72409]: DEBUG nova.network.neutron [req-a3b22c5c-85b4-434e-93c7-3265a7f6b2bd req-81d808cf-454e-4ef7-9c16-d49ab465dc2a service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:28:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-a3b22c5c-85b4-434e-93c7-3265a7f6b2bd req-81d808cf-454e-4ef7-9c16-d49ab465dc2a service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Detach interface failed, port_id=f5354856-2be8-4f87-9d6c-5c5f1d46eadd, reason: Instance 63087b74-63f6-40da-ae2b-62e170fafa9c could not be found. {{(pid=72409) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 23:28:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:28:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:28:44 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:28:44 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:28:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:28:44 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Deleted allocations for instance 63087b74-63f6-40da-ae2b-62e170fafa9c
Aug 09 23:28:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-f86182ad-5a16-4c12-b06a-20f056624473 req-44a893c5-d21a-42cd-9aa0-a2cb6f288f5d service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Received event network-vif-plugged-f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:28:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f86182ad-5a16-4c12-b06a-20f056624473 req-44a893c5-d21a-42cd-9aa0-a2cb6f288f5d service nova] Acquiring lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:28:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f86182ad-5a16-4c12-b06a-20f056624473 req-44a893c5-d21a-42cd-9aa0-a2cb6f288f5d service nova] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:28:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-f86182ad-5a16-4c12-b06a-20f056624473 req-44a893c5-d21a-42cd-9aa0-a2cb6f288f5d service nova] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:28:44 user nova-compute[72409]: DEBUG nova.compute.manager [req-f86182ad-5a16-4c12-b06a-20f056624473 req-44a893c5-d21a-42cd-9aa0-a2cb6f288f5d service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] No waiting events found dispatching network-vif-plugged-f5354856-2be8-4f87-9d6c-5c5f1d46eadd {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:28:44 user nova-compute[72409]: WARNING nova.compute.manager [req-f86182ad-5a16-4c12-b06a-20f056624473 req-44a893c5-d21a-42cd-9aa0-a2cb6f288f5d service nova] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Received unexpected event network-vif-plugged-f5354856-2be8-4f87-9d6c-5c5f1d46eadd for instance with vm_state deleted and task_state None.
Aug 09 23:28:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-aae8d996-c7b1-4dd1-bcc1-1ada328cdf51 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714 tempest-TestServerVolumeAttachScenarioOldVersion-1460686714-project-member] Lock "63087b74-63f6-40da-ae2b-62e170fafa9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.538s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:28:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:57 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691623722.5736089, 63087b74-63f6-40da-ae2b-62e170fafa9c => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:28:57 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] VM Stopped (Lifecycle Event)
Aug 09 23:28:57 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8b831a4e-9198-447e-ad38-0fe842a0cbac None None] [instance: 63087b74-63f6-40da-ae2b-62e170fafa9c] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:28:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:28:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:28:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:28:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:28:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:28:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:29:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:29:16 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:29:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:29:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:29:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:29:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:29:21 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:29:21 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:22 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:29:22 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:29:22 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=25.2911376953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7f3d6e45-f630-475b-aa04-216863dc0e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:29:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:29:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:29:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:29:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:29:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:29:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:29:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:29:28 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updating instance_info_cache with network_info: [{"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:29:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:29:28 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:29:28 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:29:28 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:29:29 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:29:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:29:30 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:29:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:29:33 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:29:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-041a5c89-3f15-4405-8b01-3a69b3ad36b0 req-bc5cfbfc-4186-4086-af72-974c49e1a081 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Received event network-changed-baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:29:45 user nova-compute[72409]: DEBUG nova.compute.manager [req-041a5c89-3f15-4405-8b01-3a69b3ad36b0 req-bc5cfbfc-4186-4086-af72-974c49e1a081 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Refreshing instance network info cache due to event network-changed-baad5df1-e132-4651-b8f0-b138b54b93bd. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:29:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-041a5c89-3f15-4405-8b01-3a69b3ad36b0 req-bc5cfbfc-4186-4086-af72-974c49e1a081 service nova] Acquiring lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:29:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-041a5c89-3f15-4405-8b01-3a69b3ad36b0 req-bc5cfbfc-4186-4086-af72-974c49e1a081 service nova] Acquired lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:29:45 user nova-compute[72409]: DEBUG nova.network.neutron [req-041a5c89-3f15-4405-8b01-3a69b3ad36b0 req-bc5cfbfc-4186-4086-af72-974c49e1a081 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Refreshing network info cache for port baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:29:45 user nova-compute[72409]: DEBUG nova.network.neutron [req-041a5c89-3f15-4405-8b01-3a69b3ad36b0 req-bc5cfbfc-4186-4086-af72-974c49e1a081 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updated VIF entry in instance network info cache for port baad5df1-e132-4651-b8f0-b138b54b93bd. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:29:45 user nova-compute[72409]: DEBUG nova.network.neutron [req-041a5c89-3f15-4405-8b01-3a69b3ad36b0 req-bc5cfbfc-4186-4086-af72-974c49e1a081 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updating instance_info_cache with network_info: [{"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:29:45 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-041a5c89-3f15-4405-8b01-3a69b3ad36b0 req-bc5cfbfc-4186-4086-af72-974c49e1a081 service nova] Releasing lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:29:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "7f3d6e45-f630-475b-aa04-216863dc0e26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:29:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:29:48 user nova-compute[72409]: DEBUG nova.objects.instance [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'flavor' on Instance uuid 7f3d6e45-f630-475b-aa04-216863dc0e26 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:29:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "7f3d6e45-f630-475b-aa04-216863dc0e26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:29:49 user nova-compute[72409]: INFO nova.compute.manager [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Attaching volume 745ba70a-2185-4bc0-936c-a0ea3c5439ea to /dev/vdb
Aug 09 23:29:49 user nova-compute[72409]: DEBUG os_brick.utils [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b89ba1-5ddd-4d53-864b-98f8384fd517]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f705218-6247-4e1f-bfde-ddfad0f8e863]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16dbaed-d1dd-4277-bf7a-8818fcfecc0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2c5ce9-d2f8-4d75-80dd-bd5906793863]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:29:49 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:29:49 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5a92ec-e3ab-4cdc-ba29-ad7c7c19babf]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG os_brick.utils [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:29:49 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updating existing volume attachment record: 3fef6e87-7abc-4d57-8f0a-a68eeace6087 {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:29:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAbNavgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:29:57 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:29:57 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:29:57 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[43520336-3c5a-463a-944e-144221ec45ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:29:57 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a2ed94-63c3-45bb-bd2e-5a23e7b40d5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea] added
Aug 09 23:29:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef6612b-a9e6-4a70-b45d-bcd8a11f2b47]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4fa37b-40e7-47e0-a172-5f5cb0e03de1]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dAbNavgD {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dAbNavgD" returned: 0 in 0.023s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad00a0a7-18d1-4049-84a4-63469c92b832]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dAbNavgD'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1ff18e-f3e8-449b-99c1-3f2a00d1547b]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8eb055-0e8d-4dae-a400-82fb66f23374]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:29:57 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:29:57 user nova-compute[72409]:  {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:29:57 user nova-compute[72409]: WARNING os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 23:29:57 user nova-compute[72409]: 
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fcb0e9-47fd-40ca-884e-94d73c10ead9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea, portal: 172.16.0.220,3260]
Aug 09 23:29:57 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea, portal: 172.16.0.220,3260] successful.
Aug 09 23:29:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d076c048-5c1b-46b8-9443-c71e6f34b1dc]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afa072c-890b-4aea-9880-388d0a147c8c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea (non-flash)
Aug 09 23:29:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea (non-flash)
Aug 09 23:29:57 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9ad2a6-281e-4860-96df-dfc47c6790f9]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:29:57 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:29:58 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:29:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAbNavgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:29:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:29:58 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23033316431343865', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:29:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033316431343865', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:29:58 user nova-compute[72409]: DEBUG nova.objects.instance [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'flavor' on Instance uuid 7f3d6e45-f630-475b-aa04-216863dc0e26 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:29:58 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:29:58 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:29:58 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:29:58 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:29:58 user nova-compute[72409]:   <serial>745ba70a-2185-4bc0-936c-a0ea3c5439ea</serial>
Aug 09 23:29:58 user nova-compute[72409]: </disk>
Aug 09 23:29:58 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:29:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:29:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:29:59 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No VIF found with MAC fa:16:3e:4d:75:8b, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:29:59 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d3708453-d92f-4359-85a0-8275258f6a1a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.209s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:30:02 user nova-compute[72409]: INFO nova.compute.claims [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Claim successful on node user
Aug 09 23:30:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG nova.network.neutron [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:30:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:30:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG nova.policy [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17d9e59fb7444f06bd3f27c0ecf55cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c2a26aea0b400389c76c17af8ba663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG nova.compute.manager [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:30:02 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Creating image(s)
Aug 09 23:30:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "/opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "/opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:30:02 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.159s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk 1073741824" returned: 0 in 0.051s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Cannot resize image /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG nova.objects.instance [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'migration_context' on Instance uuid 8c7ddb71-9cd8-4bdb-83a0-785a97133b05 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Ensure instance console log exists: /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:30:03 user nova-compute[72409]: DEBUG nova.network.neutron [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Successfully created port: fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Successfully updated port: fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "refresh_cache-8c7ddb71-9cd8-4bdb-83a0-785a97133b05" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquired lock "refresh_cache-8c7ddb71-9cd8-4bdb-83a0-785a97133b05" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-778f17d8-a9f1-4dff-a971-c2c18038d5ac req-1f8c10db-a000-454b-8675-0c64f5470074 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Received event network-changed-fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.compute.manager [req-778f17d8-a9f1-4dff-a971-c2c18038d5ac req-1f8c10db-a000-454b-8675-0c64f5470074 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Refreshing instance network info cache due to event network-changed-fb67781c-020d-410b-b6f3-f93494369013. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-778f17d8-a9f1-4dff-a971-c2c18038d5ac req-1f8c10db-a000-454b-8675-0c64f5470074 service nova] Acquiring lock "refresh_cache-8c7ddb71-9cd8-4bdb-83a0-785a97133b05" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.network.neutron [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Updating instance_info_cache with network_info: [{"id": "fb67781c-020d-410b-b6f3-f93494369013", "address": "fa:16:3e:0c:6f:49", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb67781c-02", "ovs_interfaceid": "fb67781c-020d-410b-b6f3-f93494369013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Releasing lock "refresh_cache-8c7ddb71-9cd8-4bdb-83a0-785a97133b05" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.compute.manager [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Instance network_info: |[{"id": "fb67781c-020d-410b-b6f3-f93494369013", "address": "fa:16:3e:0c:6f:49", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb67781c-02", "ovs_interfaceid": "fb67781c-020d-410b-b6f3-f93494369013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-778f17d8-a9f1-4dff-a971-c2c18038d5ac req-1f8c10db-a000-454b-8675-0c64f5470074 service nova] Acquired lock "refresh_cache-8c7ddb71-9cd8-4bdb-83a0-785a97133b05" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.network.neutron [req-778f17d8-a9f1-4dff-a971-c2c18038d5ac req-1f8c10db-a000-454b-8675-0c64f5470074 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Refreshing network info cache for port fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Start _get_guest_xml network_info=[{"id": "fb67781c-020d-410b-b6f3-f93494369013", "address": "fa:16:3e:0c:6f:49", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb67781c-02", "ovs_interfaceid": "fb67781c-020d-410b-b6f3-f93494369013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:30:04 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:30:04 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-841398009',display_name='tempest-AttachVolumeNegativeTest-server-841398009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-841398009',id=49,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkm5+iHii+dNvUB6eRW3ph944y3y14tzg0zMyA/QeWbwe3sbw19Ka+vMlhSpIG7+qSVcMbXoEARZtKS6N4J3Ass2N1fayBDPBePUdw6w3fF/djXCOq/rdI5/GBPACspzw==',key_name='tempest-keypair-1975947555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8c2a26aea0b400389c76c17af8ba663',ramdisk_id='',reservation_id='r-wrxz2t2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1895927455',owner_user_name='tempest-AttachVolumeNegativeTest-1895927455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17d9e59fb7444f06bd3f27c0ecf55cec',uuid=8c7ddb71-9cd8-4bdb-83a0-785a97133b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb67781c-020d-410b-b6f3-f93494369013", "address": "fa:16:3e:0c:6f:49", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb67781c-02", "ovs_interfaceid": "fb67781c-020d-410b-b6f3-f93494369013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converting VIF {"id": "fb67781c-020d-410b-b6f3-f93494369013", "address": "fa:16:3e:0c:6f:49", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb67781c-02", "ovs_interfaceid": "fb67781c-020d-410b-b6f3-f93494369013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6f:49,bridge_name='br-int',has_traffic_filtering=True,id=fb67781c-020d-410b-b6f3-f93494369013,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb67781c-02') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.objects.instance [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c7ddb71-9cd8-4bdb-83a0-785a97133b05 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:30:04 user nova-compute[72409]:   <uuid>8c7ddb71-9cd8-4bdb-83a0-785a97133b05</uuid>
Aug 09 23:30:04 user nova-compute[72409]:   <name>instance-00000031</name>
Aug 09 23:30:04 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:30:04 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:30:04 user nova-compute[72409]:   <metadata>
Aug 09 23:30:04 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:30:04 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:30:04 user nova-compute[72409]:       <nova:name>tempest-AttachVolumeNegativeTest-server-841398009</nova:name>
Aug 09 23:30:04 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:30:04</nova:creationTime>
Aug 09 23:30:04 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:30:04 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:30:04 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:30:04 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:30:04 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:30:04 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:30:04 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:30:04 user nova-compute[72409]:       <nova:owner>
Aug 09 23:30:04 user nova-compute[72409]:         <nova:user uuid="17d9e59fb7444f06bd3f27c0ecf55cec">tempest-AttachVolumeNegativeTest-1895927455-project-member</nova:user>
Aug 09 23:30:04 user nova-compute[72409]:         <nova:project uuid="f8c2a26aea0b400389c76c17af8ba663">tempest-AttachVolumeNegativeTest-1895927455</nova:project>
Aug 09 23:30:04 user nova-compute[72409]:       </nova:owner>
Aug 09 23:30:04 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:30:04 user nova-compute[72409]:       <nova:ports>
Aug 09 23:30:04 user nova-compute[72409]:         <nova:port uuid="fb67781c-020d-410b-b6f3-f93494369013">
Aug 09 23:30:04 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 23:30:04 user nova-compute[72409]:         </nova:port>
Aug 09 23:30:04 user nova-compute[72409]:       </nova:ports>
Aug 09 23:30:04 user nova-compute[72409]:     </nova:instance>
Aug 09 23:30:04 user nova-compute[72409]:   </metadata>
Aug 09 23:30:04 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:30:04 user nova-compute[72409]:     <system>
Aug 09 23:30:04 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:30:04 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:30:04 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:30:04 user nova-compute[72409]:       <entry name="serial">8c7ddb71-9cd8-4bdb-83a0-785a97133b05</entry>
Aug 09 23:30:04 user nova-compute[72409]:       <entry name="uuid">8c7ddb71-9cd8-4bdb-83a0-785a97133b05</entry>
Aug 09 23:30:04 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:30:04 user nova-compute[72409]:     </system>
Aug 09 23:30:04 user nova-compute[72409]:   </sysinfo>
Aug 09 23:30:04 user nova-compute[72409]:   <os>
Aug 09 23:30:04 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:30:04 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:30:04 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:30:04 user nova-compute[72409]:   </os>
Aug 09 23:30:04 user nova-compute[72409]:   <features>
Aug 09 23:30:04 user nova-compute[72409]:     <acpi/>
Aug 09 23:30:04 user nova-compute[72409]:     <apic/>
Aug 09 23:30:04 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:30:04 user nova-compute[72409]:   </features>
Aug 09 23:30:04 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:30:04 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:30:04 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:30:04 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:30:04 user nova-compute[72409]:   </clock>
Aug 09 23:30:04 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:30:04 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:30:04 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:30:04 user nova-compute[72409]:   </cpu>
Aug 09 23:30:04 user nova-compute[72409]:   <devices>
Aug 09 23:30:04 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:30:04 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:30:04 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk"/>
Aug 09 23:30:04 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:30:04 user nova-compute[72409]:     </disk>
Aug 09 23:30:04 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:30:04 user nova-compute[72409]:       <mac address="fa:16:3e:0c:6f:49"/>
Aug 09 23:30:04 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:30:04 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:30:04 user nova-compute[72409]:       <target dev="tapfb67781c-02"/>
Aug 09 23:30:04 user nova-compute[72409]:     </interface>
Aug 09 23:30:04 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:30:04 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/console.log" append="off"/>
Aug 09 23:30:04 user nova-compute[72409]:     </serial>
Aug 09 23:30:04 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:30:04 user nova-compute[72409]:     <video>
Aug 09 23:30:04 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:30:04 user nova-compute[72409]:     </video>
Aug 09 23:30:04 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:30:04 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:30:04 user nova-compute[72409]:     </rng>
Aug 09 23:30:04 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:30:04 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:30:04 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:30:04 user nova-compute[72409]:     </memballoon>
Aug 09 23:30:04 user nova-compute[72409]:   </devices>
Aug 09 23:30:04 user nova-compute[72409]: </domain>
Aug 09 23:30:04 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-841398009',display_name='tempest-AttachVolumeNegativeTest-server-841398009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-841398009',id=49,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkm5+iHii+dNvUB6eRW3ph944y3y14tzg0zMyA/QeWbwe3sbw19Ka+vMlhSpIG7+qSVcMbXoEARZtKS6N4J3Ass2N1fayBDPBePUdw6w3fF/djXCOq/rdI5/GBPACspzw==',key_name='tempest-keypair-1975947555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8c2a26aea0b400389c76c17af8ba663',ramdisk_id='',reservation_id='r-wrxz2t2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1895927455',owner_user_name='tempest-AttachVolumeNegativeTest-1895927455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17d9e59fb7444f06bd3f27c0ecf55cec',uuid=8c7ddb71-9cd8-4bdb-83a0-785a97133b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb67781c-020d-410b-b6f3-f93494369013", "address": "fa:16:3e:0c:6f:49", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb67781c-02", "ovs_interfaceid": "fb67781c-020d-410b-b6f3-f93494369013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converting VIF {"id": "fb67781c-020d-410b-b6f3-f93494369013", "address": "fa:16:3e:0c:6f:49", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb67781c-02", "ovs_interfaceid": "fb67781c-020d-410b-b6f3-f93494369013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6f:49,bridge_name='br-int',has_traffic_filtering=True,id=fb67781c-020d-410b-b6f3-f93494369013,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb67781c-02') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG os_vif [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6f:49,bridge_name='br-int',has_traffic_filtering=True,id=fb67781c-020d-410b-b6f3-f93494369013,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb67781c-02') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb67781c-02, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb67781c-02, col_values=(('external_ids', {'iface-id': 'fb67781c-020d-410b-b6f3-f93494369013', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:6f:49', 'vm-uuid': '8c7ddb71-9cd8-4bdb-83a0-785a97133b05'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:04 user nova-compute[72409]: INFO os_vif [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:6f:49,bridge_name='br-int',has_traffic_filtering=True,id=fb67781c-020d-410b-b6f3-f93494369013,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb67781c-02')
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:30:04 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No VIF found with MAC fa:16:3e:0c:6f:49, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:30:05 user nova-compute[72409]: DEBUG nova.network.neutron [req-778f17d8-a9f1-4dff-a971-c2c18038d5ac req-1f8c10db-a000-454b-8675-0c64f5470074 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Updated VIF entry in instance network info cache for port fb67781c-020d-410b-b6f3-f93494369013. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:30:05 user nova-compute[72409]: DEBUG nova.network.neutron [req-778f17d8-a9f1-4dff-a971-c2c18038d5ac req-1f8c10db-a000-454b-8675-0c64f5470074 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Updating instance_info_cache with network_info: [{"id": "fb67781c-020d-410b-b6f3-f93494369013", "address": "fa:16:3e:0c:6f:49", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb67781c-02", "ovs_interfaceid": "fb67781c-020d-410b-b6f3-f93494369013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:30:05 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-778f17d8-a9f1-4dff-a971-c2c18038d5ac req-1f8c10db-a000-454b-8675-0c64f5470074 service nova] Releasing lock "refresh_cache-8c7ddb71-9cd8-4bdb-83a0-785a97133b05" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:30:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:06 user nova-compute[72409]: DEBUG nova.compute.manager [req-a546d57b-2062-486f-be2e-fceaa5596a88 req-e8eb5b4e-95b8-4669-b8fe-f8519bd57ec9 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Received event network-vif-plugged-fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:30:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a546d57b-2062-486f-be2e-fceaa5596a88 req-e8eb5b4e-95b8-4669-b8fe-f8519bd57ec9 service nova] Acquiring lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:30:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a546d57b-2062-486f-be2e-fceaa5596a88 req-e8eb5b4e-95b8-4669-b8fe-f8519bd57ec9 service nova] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:30:06 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a546d57b-2062-486f-be2e-fceaa5596a88 req-e8eb5b4e-95b8-4669-b8fe-f8519bd57ec9 service nova] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:30:06 user nova-compute[72409]: DEBUG nova.compute.manager [req-a546d57b-2062-486f-be2e-fceaa5596a88 req-e8eb5b4e-95b8-4669-b8fe-f8519bd57ec9 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] No waiting events found dispatching network-vif-plugged-fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:30:06 user nova-compute[72409]: WARNING nova.compute.manager [req-a546d57b-2062-486f-be2e-fceaa5596a88 req-e8eb5b4e-95b8-4669-b8fe-f8519bd57ec9 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Received unexpected event network-vif-plugged-fb67781c-020d-410b-b6f3-f93494369013 for instance with vm_state building and task_state spawning.
Aug 09 23:30:06 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623808.3451169, 8c7ddb71-9cd8-4bdb-83a0-785a97133b05 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:30:08 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] VM Resumed (Lifecycle Event)
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:30:08 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Instance spawned successfully.
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:30:08 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691623808.3488503, 8c7ddb71-9cd8-4bdb-83a0-785a97133b05 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:30:08 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] VM Started (Lifecycle Event)
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:30:08 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:30:08 user nova-compute[72409]: INFO nova.compute.manager [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.compute.manager [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:30:08 user nova-compute[72409]: INFO nova.compute.manager [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Took 6.07 seconds to build instance.
Aug 09 23:30:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-19e77388-2f5a-408c-aa3e-6aba64a5e851 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.163s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.compute.manager [req-ad2dad90-efd7-4890-8127-091b1dc0d048 req-8b37a497-a7b3-428a-b2a4-ef277e15e8c9 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Received event network-vif-plugged-fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ad2dad90-efd7-4890-8127-091b1dc0d048 req-8b37a497-a7b3-428a-b2a4-ef277e15e8c9 service nova] Acquiring lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ad2dad90-efd7-4890-8127-091b1dc0d048 req-8b37a497-a7b3-428a-b2a4-ef277e15e8c9 service nova] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ad2dad90-efd7-4890-8127-091b1dc0d048 req-8b37a497-a7b3-428a-b2a4-ef277e15e8c9 service nova] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:30:08 user nova-compute[72409]: DEBUG nova.compute.manager [req-ad2dad90-efd7-4890-8127-091b1dc0d048 req-8b37a497-a7b3-428a-b2a4-ef277e15e8c9 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] No waiting events found dispatching network-vif-plugged-fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:30:08 user nova-compute[72409]: WARNING nova.compute.manager [req-ad2dad90-efd7-4890-8127-091b1dc0d048 req-8b37a497-a7b3-428a-b2a4-ef277e15e8c9 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Received unexpected event network-vif-plugged-fb67781c-020d-410b-b6f3-f93494369013 for instance with vm_state active and task_state None.
Aug 09 23:30:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:16 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:30:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:22 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:30:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:30:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:30:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:30:22 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:30:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:30:23 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:30:23 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:30:23 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8659MB free_disk=25.261882781982422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7f3d6e45-f630-475b-aa04-216863dc0e26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8c7ddb71-9cd8-4bdb-83a0-785a97133b05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:30:23 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:30:24 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:30:24 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:30:24 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:30:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:30:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:26 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:30:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:30:29 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:30:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:30:29 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:30:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:30:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:30:29 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:30:29 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 7f3d6e45-f630-475b-aa04-216863dc0e26 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:30:30 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updating instance_info_cache with network_info: [{"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:30:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:30:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:30:30 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:30:30 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:30:30 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:30:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:30:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:30:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:35 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:30:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:30:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:31:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:31:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:12 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:31:12 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 23:31:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:31:17 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:31:19 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:31:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 23:31:19 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] There are 0 instances to clean {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 23:31:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:31:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:31:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:31:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:31:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:31:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:23 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:31:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:31:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:31:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:31:23 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:31:23 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:31:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:31:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:31:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:31:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:31:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:31:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:31:24 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:31:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:25 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:31:25 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8767MB free_disk=25.259601593017578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7f3d6e45-f630-475b-aa04-216863dc0e26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 8c7ddb71-9cd8-4bdb-83a0-785a97133b05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing inventories for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating ProviderTree inventory for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing aggregate associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, aggregates: None {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing trait associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:31:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:31:26 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:31:27 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:31:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:31:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:31:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:31:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:31:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:30 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:31:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:31:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-8c7ddb71-9cd8-4bdb-83a0-785a97133b05" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:31:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-8c7ddb71-9cd8-4bdb-83a0-785a97133b05" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:31:31 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:31:31 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Updating instance_info_cache with network_info: [{"id": "fb67781c-020d-410b-b6f3-f93494369013", "address": "fa:16:3e:0c:6f:49", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb67781c-02", "ovs_interfaceid": "fb67781c-020d-410b-b6f3-f93494369013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:31:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-8c7ddb71-9cd8-4bdb-83a0-785a97133b05" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:31:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:31:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:31:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:31:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:31:32 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:31:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:36 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:31:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:31:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:31:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:31:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:31:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:31:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:31:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:31:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:31:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:31:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:31:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-3e264827-724b-46fd-85a4-1c7ec7e8fc2f req-9d686252-d60f-48e7-8d04-36f76b0359f4 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Received event network-changed-fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:31:54 user nova-compute[72409]: DEBUG nova.compute.manager [req-3e264827-724b-46fd-85a4-1c7ec7e8fc2f req-9d686252-d60f-48e7-8d04-36f76b0359f4 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Refreshing instance network info cache due to event network-changed-fb67781c-020d-410b-b6f3-f93494369013. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:31:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3e264827-724b-46fd-85a4-1c7ec7e8fc2f req-9d686252-d60f-48e7-8d04-36f76b0359f4 service nova] Acquiring lock "refresh_cache-8c7ddb71-9cd8-4bdb-83a0-785a97133b05" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:31:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3e264827-724b-46fd-85a4-1c7ec7e8fc2f req-9d686252-d60f-48e7-8d04-36f76b0359f4 service nova] Acquired lock "refresh_cache-8c7ddb71-9cd8-4bdb-83a0-785a97133b05" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:31:54 user nova-compute[72409]: DEBUG nova.network.neutron [req-3e264827-724b-46fd-85a4-1c7ec7e8fc2f req-9d686252-d60f-48e7-8d04-36f76b0359f4 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Refreshing network info cache for port fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:31:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:31:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:31:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:31:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:31:54 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:31:54 user nova-compute[72409]: INFO nova.compute.manager [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Terminating instance
Aug 09 23:31:54 user nova-compute[72409]: DEBUG nova.compute.manager [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:31:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG nova.network.neutron [req-3e264827-724b-46fd-85a4-1c7ec7e8fc2f req-9d686252-d60f-48e7-8d04-36f76b0359f4 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Updated VIF entry in instance network info cache for port fb67781c-020d-410b-b6f3-f93494369013. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG nova.network.neutron [req-3e264827-724b-46fd-85a4-1c7ec7e8fc2f req-9d686252-d60f-48e7-8d04-36f76b0359f4 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Updating instance_info_cache with network_info: [{"id": "fb67781c-020d-410b-b6f3-f93494369013", "address": "fa:16:3e:0c:6f:49", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb67781c-02", "ovs_interfaceid": "fb67781c-020d-410b-b6f3-f93494369013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-3e264827-724b-46fd-85a4-1c7ec7e8fc2f req-9d686252-d60f-48e7-8d04-36f76b0359f4 service nova] Releasing lock "refresh_cache-8c7ddb71-9cd8-4bdb-83a0-785a97133b05" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:55 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Instance destroyed successfully.
Aug 09 23:31:55 user nova-compute[72409]: DEBUG nova.objects.instance [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'resources' on Instance uuid 8c7ddb71-9cd8-4bdb-83a0-785a97133b05 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:30:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-841398009',display_name='tempest-AttachVolumeNegativeTest-server-841398009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-841398009',id=49,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkm5+iHii+dNvUB6eRW3ph944y3y14tzg0zMyA/QeWbwe3sbw19Ka+vMlhSpIG7+qSVcMbXoEARZtKS6N4J3Ass2N1fayBDPBePUdw6w3fF/djXCOq/rdI5/GBPACspzw==',key_name='tempest-keypair-1975947555',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:30:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8c2a26aea0b400389c76c17af8ba663',ramdisk_id='',reservation_id='r-wrxz2t2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1895927455',owner_user_name='tempest-AttachVolumeNegativeTest-1895927455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17d9e59fb7444f06bd3f27c0ecf55cec',uuid=8c7ddb71-9cd8-4bdb-83a0-785a97133b05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb67781c-020d-410b-b6f3-f93494369013", "address": "fa:16:3e:0c:6f:49", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb67781c-02", "ovs_interfaceid": "fb67781c-020d-410b-b6f3-f93494369013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converting VIF {"id": "fb67781c-020d-410b-b6f3-f93494369013", "address": "fa:16:3e:0c:6f:49", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb67781c-02", "ovs_interfaceid": "fb67781c-020d-410b-b6f3-f93494369013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6f:49,bridge_name='br-int',has_traffic_filtering=True,id=fb67781c-020d-410b-b6f3-f93494369013,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb67781c-02') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG os_vif [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6f:49,bridge_name='br-int',has_traffic_filtering=True,id=fb67781c-020d-410b-b6f3-f93494369013,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb67781c-02') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb67781c-02, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:31:55 user nova-compute[72409]: INFO os_vif [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:6f:49,bridge_name='br-int',has_traffic_filtering=True,id=fb67781c-020d-410b-b6f3-f93494369013,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb67781c-02')
Aug 09 23:31:55 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Deleting instance files /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05_del
Aug 09 23:31:55 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Deletion of /opt/stack/data/nova/instances/8c7ddb71-9cd8-4bdb-83a0-785a97133b05_del complete
Aug 09 23:31:55 user nova-compute[72409]: INFO nova.compute.manager [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 23:31:55 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-b28cbce9-e66b-472a-9741-814275c00c4c req-15b35a81-c8e1-4567-9c3b-2d89f67ea20f service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Received event network-vif-unplugged-fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b28cbce9-e66b-472a-9741-814275c00c4c req-15b35a81-c8e1-4567-9c3b-2d89f67ea20f service nova] Acquiring lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b28cbce9-e66b-472a-9741-814275c00c4c req-15b35a81-c8e1-4567-9c3b-2d89f67ea20f service nova] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b28cbce9-e66b-472a-9741-814275c00c4c req-15b35a81-c8e1-4567-9c3b-2d89f67ea20f service nova] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-b28cbce9-e66b-472a-9741-814275c00c4c req-15b35a81-c8e1-4567-9c3b-2d89f67ea20f service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] No waiting events found dispatching network-vif-unplugged-fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-b28cbce9-e66b-472a-9741-814275c00c4c req-15b35a81-c8e1-4567-9c3b-2d89f67ea20f service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Received event network-vif-unplugged-fb67781c-020d-410b-b6f3-f93494369013 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-b28cbce9-e66b-472a-9741-814275c00c4c req-15b35a81-c8e1-4567-9c3b-2d89f67ea20f service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Received event network-vif-plugged-fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b28cbce9-e66b-472a-9741-814275c00c4c req-15b35a81-c8e1-4567-9c3b-2d89f67ea20f service nova] Acquiring lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b28cbce9-e66b-472a-9741-814275c00c4c req-15b35a81-c8e1-4567-9c3b-2d89f67ea20f service nova] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b28cbce9-e66b-472a-9741-814275c00c4c req-15b35a81-c8e1-4567-9c3b-2d89f67ea20f service nova] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-b28cbce9-e66b-472a-9741-814275c00c4c req-15b35a81-c8e1-4567-9c3b-2d89f67ea20f service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] No waiting events found dispatching network-vif-plugged-fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:31:56 user nova-compute[72409]: WARNING nova.compute.manager [req-b28cbce9-e66b-472a-9741-814275c00c4c req-15b35a81-c8e1-4567-9c3b-2d89f67ea20f service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Received unexpected event network-vif-plugged-fb67781c-020d-410b-b6f3-f93494369013 for instance with vm_state active and task_state deleting.
Aug 09 23:31:56 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Took 0.79 seconds to deallocate network for instance.
Aug 09 23:31:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG nova.compute.manager [req-377a7163-7af2-4dee-b392-fb1f3be3e928 req-7b0e09e3-1e75-48e1-ac77-eb2a4e6a2e22 service nova] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Received event network-vif-deleted-fb67781c-020d-410b-b6f3-f93494369013 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:31:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:31:56 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Deleted allocations for instance 8c7ddb71-9cd8-4bdb-83a0-785a97133b05
Aug 09 23:31:56 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-49b940b9-04f9-4118-96a6-ce672c8ce7fe tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "8c7ddb71-9cd8-4bdb-83a0-785a97133b05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.961s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:31:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:07 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:32:10 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691623915.6756446, 8c7ddb71-9cd8-4bdb-83a0-785a97133b05 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:32:10 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] VM Stopped (Lifecycle Event)
Aug 09 23:32:10 user nova-compute[72409]: DEBUG nova.compute.manager [None req-b84e0464-4bf5-48f1-a6e8-0af22d1d545d None None] [instance: 8c7ddb71-9cd8-4bdb-83a0-785a97133b05] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:32:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:32:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:32:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:32:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:32:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:32:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:32:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:32:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:32:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:32:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:32:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:32:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:32:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:32:26 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:32:26 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:32:26 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=25.286632537841797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7f3d6e45-f630-475b-aa04-216863dc0e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:32:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:32:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:32:30 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:32:30 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:32:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:32:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:32:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:32:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:32:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:32:31 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:32:31 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 7f3d6e45-f630-475b-aa04-216863dc0e26 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:32:32 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updating instance_info_cache with network_info: [{"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:32:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:32:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:32:32 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:32:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:32:34 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:32:34 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:32:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:32:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:32:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:32:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:32:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:38 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:32:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:32:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:32:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:32:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:32:40 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:45 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:32:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "7f3d6e45-f630-475b-aa04-216863dc0e26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:32:46 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:32:46 user nova-compute[72409]: INFO nova.compute.manager [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Detaching volume 745ba70a-2185-4bc0-936c-a0ea3c5439ea
Aug 09 23:32:46 user nova-compute[72409]: INFO nova.virt.block_device [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Attempting to driver detach volume 745ba70a-2185-4bc0-936c-a0ea3c5439ea from mountpoint /dev/vdb
Aug 09 23:32:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Attempting to detach device vdb from instance 7f3d6e45-f630-475b-aa04-216863dc0e26 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:32:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:32:46 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:32:46 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:32:46 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:32:46 user nova-compute[72409]:   <serial>745ba70a-2185-4bc0-936c-a0ea3c5439ea</serial>
Aug 09 23:32:46 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:32:46 user nova-compute[72409]: </disk>
Aug 09 23:32:46 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:32:46 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully detached device vdb from instance 7f3d6e45-f630-475b-aa04-216863dc0e26 from the persistent domain config.
Aug 09 23:32:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f3d6e45-f630-475b-aa04-216863dc0e26 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:32:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:32:46 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:32:46 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:32:46 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:32:46 user nova-compute[72409]:   <serial>745ba70a-2185-4bc0-936c-a0ea3c5439ea</serial>
Aug 09 23:32:46 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:32:46 user nova-compute[72409]: </disk>
Aug 09 23:32:46 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:32:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691623966.9745138, 7f3d6e45-f630-475b-aa04-216863dc0e26 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:32:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f3d6e45-f630-475b-aa04-216863dc0e26 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:32:46 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully detached device vdb from instance 7f3d6e45-f630-475b-aa04-216863dc0e26 from the live domain config.
Aug 09 23:32:46 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:32:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAbNavgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:32:46 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:32:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:32:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:32:46 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:32:46 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af0fe34-d664-4afa-b4be-55b55c1a6e71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1a3cdf-fb57-4288-92a7-a0fb752f858d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea (non-flash)
Aug 09 23:32:47 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea (non-flash)
Aug 09 23:32:47 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e8449e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9843da9b-4966-49d7-8f9a-26cef5f4489c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f39fdd-dff7-471c-b397-5b056f775883]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e00ee94-544a-4460-8581-72490bcb3007]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d269622-9951-4030-a82a-fff58b6f2748]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4fc1a6-5f62-46fa-9b5e-37614a9d6392]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf285625-35d2-4485-b572-29198793cfb7]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea, portal: 172.16.0.220,3260]
Aug 09 23:32:47 user nova-compute[72409]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea, portal: 172.16.0.220,3260] successful.
Aug 09 23:32:47 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:745ba70a-2185-4bc0-936c-a0ea3c5439ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a5fa1c-d663-4171-a666-deceef9fad37]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] <== disconnect_volume: return (261ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:32:47 user nova-compute[72409]: DEBUG nova.objects.instance [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'flavor' on Instance uuid 7f3d6e45-f630-475b-aa04-216863dc0e26 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:32:48 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7ea609a1-4b04-4651-ba8d-3f5a6a921d1f tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.562s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:32:50 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:32:55 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:33:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:33:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:33:00 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:33:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:33:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:33:05 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:10 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:18 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:33:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:33:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:33:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:33:20 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:33:25 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:33:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:33:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:33:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:33:26 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:33:26 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:33:26 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8840MB free_disk=25.28594207763672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:33:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:33:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:33:26 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 7f3d6e45-f630-475b-aa04-216863dc0e26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:33:26 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:33:26 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:33:26 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:33:26 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:33:26 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:33:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:33:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:33:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:33:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:33:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:33:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:33:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:33:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:33:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:33:31 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:33:31 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 7f3d6e45-f630-475b-aa04-216863dc0e26 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:33:32 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updating instance_info_cache with network_info: [{"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:33:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-7f3d6e45-f630-475b-aa04-216863dc0e26" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:33:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:33:32 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:33:32 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:33:32 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:33:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:33:34 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:33:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "7f3d6e45-f630-475b-aa04-216863dc0e26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:33:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:33:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:33:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:33:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:33:36 user nova-compute[72409]: INFO nova.compute.manager [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Terminating instance
Aug 09 23:33:36 user nova-compute[72409]: DEBUG nova.compute.manager [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:33:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:36 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-ddbc3007-0d22-47c2-af56-a2204622078f req-f8ba479b-059f-4633-b99a-5f607d2fd0fd service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Received event network-vif-unplugged-baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ddbc3007-0d22-47c2-af56-a2204622078f req-f8ba479b-059f-4633-b99a-5f607d2fd0fd service nova] Acquiring lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ddbc3007-0d22-47c2-af56-a2204622078f req-f8ba479b-059f-4633-b99a-5f607d2fd0fd service nova] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-ddbc3007-0d22-47c2-af56-a2204622078f req-f8ba479b-059f-4633-b99a-5f607d2fd0fd service nova] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-ddbc3007-0d22-47c2-af56-a2204622078f req-f8ba479b-059f-4633-b99a-5f607d2fd0fd service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] No waiting events found dispatching network-vif-unplugged-baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-ddbc3007-0d22-47c2-af56-a2204622078f req-f8ba479b-059f-4633-b99a-5f607d2fd0fd service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Received event network-vif-unplugged-baad5df1-e132-4651-b8f0-b138b54b93bd for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:37 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Instance destroyed successfully.
Aug 09 23:33:37 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'resources' on Instance uuid 7f3d6e45-f630-475b-aa04-216863dc0e26 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:27:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1830493295',display_name='tempest-AttachVolumeNegativeTest-server-1830493295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1830493295',id=48,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGweeJJH+HqeE/VidCu4agwluIy1D4QBbwiSsn5fpawFT/XYPkUVT1O1R4k8KCvOvW6DhpICxfFDGU/LuMOjGvbpu5h6rwtJYonP+5T8kFm4GCLdkZl6a1mrrMgpI9sZ2Q==',key_name='tempest-keypair-1930207951',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:27:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8c2a26aea0b400389c76c17af8ba663',ramdisk_id='',reservation_id='r-qmks26qv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1895927455',owner_user_name='tempest-AttachVolumeNegativeTest-1895927455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:28:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17d9e59fb7444f06bd3f27c0ecf55cec',uuid=7f3d6e45-f630-475b-aa04-216863dc0e26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converting VIF {"id": "baad5df1-e132-4651-b8f0-b138b54b93bd", "address": "fa:16:3e:4d:75:8b", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaad5df1-e1", "ovs_interfaceid": "baad5df1-e132-4651-b8f0-b138b54b93bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:75:8b,bridge_name='br-int',has_traffic_filtering=True,id=baad5df1-e132-4651-b8f0-b138b54b93bd,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaad5df1-e1') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG os_vif [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:75:8b,bridge_name='br-int',has_traffic_filtering=True,id=baad5df1-e132-4651-b8f0-b138b54b93bd,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaad5df1-e1') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbaad5df1-e1, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:37 user nova-compute[72409]: INFO os_vif [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:75:8b,bridge_name='br-int',has_traffic_filtering=True,id=baad5df1-e132-4651-b8f0-b138b54b93bd,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaad5df1-e1')
Aug 09 23:33:37 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Deleting instance files /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26_del
Aug 09 23:33:37 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Deletion of /opt/stack/data/nova/instances/7f3d6e45-f630-475b-aa04-216863dc0e26_del complete
Aug 09 23:33:37 user nova-compute[72409]: INFO nova.compute.manager [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 09 23:33:37 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:33:37 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:33:38 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:33:38 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Took 0.77 seconds to deallocate network for instance.
Aug 09 23:33:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:33:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:33:38 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:33:38 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:33:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:33:38 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Deleted allocations for instance 7f3d6e45-f630-475b-aa04-216863dc0e26
Aug 09 23:33:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1d189041-546f-49f5-ba2b-0915159e0b62 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.911s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:33:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-c052d8bd-eece-4e4c-a0f1-9031273ba3d3 req-e165019c-c6c9-4258-8f33-20724ba30983 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Received event network-vif-plugged-baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:33:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c052d8bd-eece-4e4c-a0f1-9031273ba3d3 req-e165019c-c6c9-4258-8f33-20724ba30983 service nova] Acquiring lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:33:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c052d8bd-eece-4e4c-a0f1-9031273ba3d3 req-e165019c-c6c9-4258-8f33-20724ba30983 service nova] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:33:39 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-c052d8bd-eece-4e4c-a0f1-9031273ba3d3 req-e165019c-c6c9-4258-8f33-20724ba30983 service nova] Lock "7f3d6e45-f630-475b-aa04-216863dc0e26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:33:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-c052d8bd-eece-4e4c-a0f1-9031273ba3d3 req-e165019c-c6c9-4258-8f33-20724ba30983 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] No waiting events found dispatching network-vif-plugged-baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:33:39 user nova-compute[72409]: WARNING nova.compute.manager [req-c052d8bd-eece-4e4c-a0f1-9031273ba3d3 req-e165019c-c6c9-4258-8f33-20724ba30983 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Received unexpected event network-vif-plugged-baad5df1-e132-4651-b8f0-b138b54b93bd for instance with vm_state deleted and task_state None.
Aug 09 23:33:39 user nova-compute[72409]: DEBUG nova.compute.manager [req-c052d8bd-eece-4e4c-a0f1-9031273ba3d3 req-e165019c-c6c9-4258-8f33-20724ba30983 service nova] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Received event network-vif-deleted-baad5df1-e132-4651-b8f0-b138b54b93bd {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:33:39 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:33:42 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:33:52 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691624017.6416986, 7f3d6e45-f630-475b-aa04-216863dc0e26 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:33:52 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] VM Stopped (Lifecycle Event)
Aug 09 23:33:52 user nova-compute[72409]: DEBUG nova.compute.manager [None req-4025ba9a-a31d-4e66-a00c-4c7a6ca9892c None None] [instance: 7f3d6e45-f630-475b-aa04-216863dc0e26] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:33:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:33:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:34:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:34:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:34:12 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:34:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:34:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:34:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:34:17 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:34:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:34:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:34:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:34:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:34:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:34:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:26 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:34:26 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:34:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:34:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:34:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:34:26 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:34:27 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:34:27 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:34:27 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.313186645507812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:34:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:34:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:34:27 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:34:27 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:34:27 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:34:27 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:34:27 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:34:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:34:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:34:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:34:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:34:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:34:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:34:30 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:34:30 user nova-compute[72409]: INFO nova.compute.claims [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Claim successful on node user
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.network.neutron [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:34:31 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.policy [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17d9e59fb7444f06bd3f27c0ecf55cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c2a26aea0b400389c76c17af8ba663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:34:31 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Creating image(s)
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "/opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "/opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "/opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk 1073741824" returned: 0 in 0.054s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.130s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Skipping network cache update for instance because it is Building. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Cannot resize image /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.objects.instance [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'migration_context' on Instance uuid 2dc4b36f-5009-4241-9b22-62bcad66e70d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Ensure instance console log exists: /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:34:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:34:32 user nova-compute[72409]: DEBUG nova.network.neutron [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Successfully created port: c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:34:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:32 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:34:32 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:34:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.network.neutron [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Successfully updated port: c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquired lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.network.neutron [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-e63ff808-0209-444a-8b3b-f811e0947209 req-f31af47b-2933-4beb-b330-b017f0fb8c15 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Received event network-changed-c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-e63ff808-0209-444a-8b3b-f811e0947209 req-f31af47b-2933-4beb-b330-b017f0fb8c15 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Refreshing instance network info cache due to event network-changed-c291c428-af9e-452b-813a-b978d5eef260. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e63ff808-0209-444a-8b3b-f811e0947209 req-f31af47b-2933-4beb-b330-b017f0fb8c15 service nova] Acquiring lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.network.neutron [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.network.neutron [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Updating instance_info_cache with network_info: [{"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Releasing lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Instance network_info: |[{"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e63ff808-0209-444a-8b3b-f811e0947209 req-f31af47b-2933-4beb-b330-b017f0fb8c15 service nova] Acquired lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.network.neutron [req-e63ff808-0209-444a-8b3b-f811e0947209 req-f31af47b-2933-4beb-b330-b017f0fb8c15 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Refreshing network info cache for port c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Start _get_guest_xml network_info=[{"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:34:33 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:34:33 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-911993736',display_name='tempest-AttachVolumeNegativeTest-server-911993736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-911993736',id=50,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC210JCk8QpVzJQbq6pXsRtJK9A5E6rGqfoKHyDD2TZkZVSpTKpRgJpuDhzIezlBIOr6+ejiof2Z8kHr3a0yz0iWftCwWs2o2oI99bCD6f+7E5LgITnVhqJXDZBySOmEw==',key_name='tempest-keypair-1288250821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8c2a26aea0b400389c76c17af8ba663',ramdisk_id='',reservation_id='r-h757fmp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1895927455',owner_user_name='tempest-AttachVolumeNegativeTest-1895927455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:34:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17d9e59fb7444f06bd3f27c0ecf55cec',uuid=2dc4b36f-5009-4241-9b22-62bcad66e70d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converting VIF {"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ae:75,bridge_name='br-int',has_traffic_filtering=True,id=c291c428-af9e-452b-813a-b978d5eef260,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc291c428-af') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.objects.instance [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dc4b36f-5009-4241-9b22-62bcad66e70d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:34:33 user nova-compute[72409]:   <uuid>2dc4b36f-5009-4241-9b22-62bcad66e70d</uuid>
Aug 09 23:34:33 user nova-compute[72409]:   <name>instance-00000032</name>
Aug 09 23:34:33 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:34:33 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:34:33 user nova-compute[72409]:   <metadata>
Aug 09 23:34:33 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:34:33 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:34:33 user nova-compute[72409]:       <nova:name>tempest-AttachVolumeNegativeTest-server-911993736</nova:name>
Aug 09 23:34:33 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:34:33</nova:creationTime>
Aug 09 23:34:33 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:34:33 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:34:33 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:34:33 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:34:33 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:34:33 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:34:33 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:34:33 user nova-compute[72409]:       <nova:owner>
Aug 09 23:34:33 user nova-compute[72409]:         <nova:user uuid="17d9e59fb7444f06bd3f27c0ecf55cec">tempest-AttachVolumeNegativeTest-1895927455-project-member</nova:user>
Aug 09 23:34:33 user nova-compute[72409]:         <nova:project uuid="f8c2a26aea0b400389c76c17af8ba663">tempest-AttachVolumeNegativeTest-1895927455</nova:project>
Aug 09 23:34:33 user nova-compute[72409]:       </nova:owner>
Aug 09 23:34:33 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:34:33 user nova-compute[72409]:       <nova:ports>
Aug 09 23:34:33 user nova-compute[72409]:         <nova:port uuid="c291c428-af9e-452b-813a-b978d5eef260">
Aug 09 23:34:33 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 23:34:33 user nova-compute[72409]:         </nova:port>
Aug 09 23:34:33 user nova-compute[72409]:       </nova:ports>
Aug 09 23:34:33 user nova-compute[72409]:     </nova:instance>
Aug 09 23:34:33 user nova-compute[72409]:   </metadata>
Aug 09 23:34:33 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:34:33 user nova-compute[72409]:     <system>
Aug 09 23:34:33 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:34:33 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:34:33 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:34:33 user nova-compute[72409]:       <entry name="serial">2dc4b36f-5009-4241-9b22-62bcad66e70d</entry>
Aug 09 23:34:33 user nova-compute[72409]:       <entry name="uuid">2dc4b36f-5009-4241-9b22-62bcad66e70d</entry>
Aug 09 23:34:33 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:34:33 user nova-compute[72409]:     </system>
Aug 09 23:34:33 user nova-compute[72409]:   </sysinfo>
Aug 09 23:34:33 user nova-compute[72409]:   <os>
Aug 09 23:34:33 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:34:33 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:34:33 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:34:33 user nova-compute[72409]:   </os>
Aug 09 23:34:33 user nova-compute[72409]:   <features>
Aug 09 23:34:33 user nova-compute[72409]:     <acpi/>
Aug 09 23:34:33 user nova-compute[72409]:     <apic/>
Aug 09 23:34:33 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:34:33 user nova-compute[72409]:   </features>
Aug 09 23:34:33 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:34:33 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:34:33 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:34:33 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:34:33 user nova-compute[72409]:   </clock>
Aug 09 23:34:33 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:34:33 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:34:33 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:34:33 user nova-compute[72409]:   </cpu>
Aug 09 23:34:33 user nova-compute[72409]:   <devices>
Aug 09 23:34:33 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:34:33 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:34:33 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk"/>
Aug 09 23:34:33 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:34:33 user nova-compute[72409]:     </disk>
Aug 09 23:34:33 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:34:33 user nova-compute[72409]:       <mac address="fa:16:3e:8c:ae:75"/>
Aug 09 23:34:33 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:34:33 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:34:33 user nova-compute[72409]:       <target dev="tapc291c428-af"/>
Aug 09 23:34:33 user nova-compute[72409]:     </interface>
Aug 09 23:34:33 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:34:33 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/console.log" append="off"/>
Aug 09 23:34:33 user nova-compute[72409]:     </serial>
Aug 09 23:34:33 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:34:33 user nova-compute[72409]:     <video>
Aug 09 23:34:33 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:34:33 user nova-compute[72409]:     </video>
Aug 09 23:34:33 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:34:33 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:34:33 user nova-compute[72409]:     </rng>
Aug 09 23:34:33 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:34:33 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:34:33 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:34:33 user nova-compute[72409]:     </memballoon>
Aug 09 23:34:33 user nova-compute[72409]:   </devices>
Aug 09 23:34:33 user nova-compute[72409]: </domain>
Aug 09 23:34:33 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-911993736',display_name='tempest-AttachVolumeNegativeTest-server-911993736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-911993736',id=50,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC210JCk8QpVzJQbq6pXsRtJK9A5E6rGqfoKHyDD2TZkZVSpTKpRgJpuDhzIezlBIOr6+ejiof2Z8kHr3a0yz0iWftCwWs2o2oI99bCD6f+7E5LgITnVhqJXDZBySOmEw==',key_name='tempest-keypair-1288250821',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8c2a26aea0b400389c76c17af8ba663',ramdisk_id='',reservation_id='r-h757fmp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1895927455',owner_user_name='tempest-AttachVolumeNegativeTest-1895927455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:34:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17d9e59fb7444f06bd3f27c0ecf55cec',uuid=2dc4b36f-5009-4241-9b22-62bcad66e70d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converting VIF {"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ae:75,bridge_name='br-int',has_traffic_filtering=True,id=c291c428-af9e-452b-813a-b978d5eef260,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc291c428-af') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG os_vif [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ae:75,bridge_name='br-int',has_traffic_filtering=True,id=c291c428-af9e-452b-813a-b978d5eef260,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc291c428-af') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc291c428-af, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc291c428-af, col_values=(('external_ids', {'iface-id': 'c291c428-af9e-452b-813a-b978d5eef260', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:ae:75', 'vm-uuid': '2dc4b36f-5009-4241-9b22-62bcad66e70d'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:33 user nova-compute[72409]: INFO os_vif [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:ae:75,bridge_name='br-int',has_traffic_filtering=True,id=c291c428-af9e-452b-813a-b978d5eef260,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc291c428-af')
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No VIF found with MAC fa:16:3e:8c:ae:75, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.network.neutron [req-e63ff808-0209-444a-8b3b-f811e0947209 req-f31af47b-2933-4beb-b330-b017f0fb8c15 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Updated VIF entry in instance network info cache for port c291c428-af9e-452b-813a-b978d5eef260. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG nova.network.neutron [req-e63ff808-0209-444a-8b3b-f811e0947209 req-f31af47b-2933-4beb-b330-b017f0fb8c15 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Updating instance_info_cache with network_info: [{"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:34:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e63ff808-0209-444a-8b3b-f811e0947209 req-f31af47b-2933-4beb-b330-b017f0fb8c15 service nova] Releasing lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:34:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:34 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:34:34 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:34:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-af25c1e0-bec7-4510-bd34-41f1aef4595a req-c2d329fb-6c7d-4a01-929a-f07b021c7e4f service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Received event network-vif-plugged-c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:34:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-af25c1e0-bec7-4510-bd34-41f1aef4595a req-c2d329fb-6c7d-4a01-929a-f07b021c7e4f service nova] Acquiring lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:34:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-af25c1e0-bec7-4510-bd34-41f1aef4595a req-c2d329fb-6c7d-4a01-929a-f07b021c7e4f service nova] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:34:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-af25c1e0-bec7-4510-bd34-41f1aef4595a req-c2d329fb-6c7d-4a01-929a-f07b021c7e4f service nova] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:34:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-af25c1e0-bec7-4510-bd34-41f1aef4595a req-c2d329fb-6c7d-4a01-929a-f07b021c7e4f service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] No waiting events found dispatching network-vif-plugged-c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:34:35 user nova-compute[72409]: WARNING nova.compute.manager [req-af25c1e0-bec7-4510-bd34-41f1aef4595a req-c2d329fb-6c7d-4a01-929a-f07b021c7e4f service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Received unexpected event network-vif-plugged-c291c428-af9e-452b-813a-b978d5eef260 for instance with vm_state building and task_state spawning.
Aug 09 23:34:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691624077.031186, 2dc4b36f-5009-4241-9b22-62bcad66e70d => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:34:37 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] VM Resumed (Lifecycle Event)
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:34:37 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Instance spawned successfully.
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:34:37 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691624077.0326455, 2dc4b36f-5009-4241-9b22-62bcad66e70d => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:34:37 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] VM Started (Lifecycle Event)
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:34:37 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:34:37 user nova-compute[72409]: INFO nova.compute.manager [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-390dc545-dd01-4483-b539-2e85d897612e req-5823d98c-9945-4a99-8773-41f806423e2e service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Received event network-vif-plugged-c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-390dc545-dd01-4483-b539-2e85d897612e req-5823d98c-9945-4a99-8773-41f806423e2e service nova] Acquiring lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-390dc545-dd01-4483-b539-2e85d897612e req-5823d98c-9945-4a99-8773-41f806423e2e service nova] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-390dc545-dd01-4483-b539-2e85d897612e req-5823d98c-9945-4a99-8773-41f806423e2e service nova] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG nova.compute.manager [req-390dc545-dd01-4483-b539-2e85d897612e req-5823d98c-9945-4a99-8773-41f806423e2e service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] No waiting events found dispatching network-vif-plugged-c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:34:37 user nova-compute[72409]: WARNING nova.compute.manager [req-390dc545-dd01-4483-b539-2e85d897612e req-5823d98c-9945-4a99-8773-41f806423e2e service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Received unexpected event network-vif-plugged-c291c428-af9e-452b-813a-b978d5eef260 for instance with vm_state building and task_state spawning.
Aug 09 23:34:37 user nova-compute[72409]: INFO nova.compute.manager [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Took 6.33 seconds to build instance.
Aug 09 23:34:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-d9fc123d-79eb-47e9-8a3d-23abd85842fc tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.466s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:34:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:39 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:34:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:34:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:34:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:34:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:34:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:34:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:35:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:35:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:35:07 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:35:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:35:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:35:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:35:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:35:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:35:26 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:35:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:35:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:35:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:35:26 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:35:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:35:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:35:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:35:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:35:27 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:35:27 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:35:27 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=25.283390045166016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:35:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:35:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:35:27 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 2dc4b36f-5009-4241-9b22-62bcad66e70d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:35:27 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:35:27 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:35:27 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:35:27 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:35:27 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:35:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:35:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:35:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:35:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:35:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:35:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:35:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:35:29 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:35:30 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:35:32 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:35:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:35:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:35:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:35:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:35:32 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:35:32 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 2dc4b36f-5009-4241-9b22-62bcad66e70d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:35:33 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Updating instance_info_cache with network_info: [{"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:35:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:35:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:35:33 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:35:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:35:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:35:34 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:35:36 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:35:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:35:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:35:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:35:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:35:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:35:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:35:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:35:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:35:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:35:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:35:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:35:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:35:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:35:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:35:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:35:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:15 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:36:15 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 23:36:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-a89be6d4-c954-47bd-b0dc-ecc2976f33ed req-4617235b-d84a-420a-8910-ce701fa58171 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Received event network-changed-c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:36:22 user nova-compute[72409]: DEBUG nova.compute.manager [req-a89be6d4-c954-47bd-b0dc-ecc2976f33ed req-4617235b-d84a-420a-8910-ce701fa58171 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Refreshing instance network info cache due to event network-changed-c291c428-af9e-452b-813a-b978d5eef260. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:36:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a89be6d4-c954-47bd-b0dc-ecc2976f33ed req-4617235b-d84a-420a-8910-ce701fa58171 service nova] Acquiring lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:36:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a89be6d4-c954-47bd-b0dc-ecc2976f33ed req-4617235b-d84a-420a-8910-ce701fa58171 service nova] Acquired lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:36:22 user nova-compute[72409]: DEBUG nova.network.neutron [req-a89be6d4-c954-47bd-b0dc-ecc2976f33ed req-4617235b-d84a-420a-8910-ce701fa58171 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Refreshing network info cache for port c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:36:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:22 user nova-compute[72409]: DEBUG nova.network.neutron [req-a89be6d4-c954-47bd-b0dc-ecc2976f33ed req-4617235b-d84a-420a-8910-ce701fa58171 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Updated VIF entry in instance network info cache for port c291c428-af9e-452b-813a-b978d5eef260. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:36:22 user nova-compute[72409]: DEBUG nova.network.neutron [req-a89be6d4-c954-47bd-b0dc-ecc2976f33ed req-4617235b-d84a-420a-8910-ce701fa58171 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Updating instance_info_cache with network_info: [{"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:36:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a89be6d4-c954-47bd-b0dc-ecc2976f33ed req-4617235b-d84a-420a-8910-ce701fa58171 service nova] Releasing lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:36:22 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:36:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:36:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:36:25 user nova-compute[72409]: DEBUG nova.objects.instance [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'flavor' on Instance uuid 2dc4b36f-5009-4241-9b22-62bcad66e70d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:36:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:36:26 user nova-compute[72409]: INFO nova.compute.manager [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Attaching volume 262eee9c-d95c-434e-9af4-9fdddb1c1738 to /dev/vdb
Aug 09 23:36:26 user nova-compute[72409]: DEBUG os_brick.utils [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f2f6ed-79a0-44b6-9521-6b3a6ae57cd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3a3895-565b-443e-9cae-f16dfe191e41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8183d573-d80e-4931-a86d-d072936b59df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c055264-49fa-4127-a463-39291054f80d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:36:26 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:36:26 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d449787d-c42a-47b3-8514-5a64a5e333ed]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG os_brick.utils [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:36:26 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Updating existing volume attachment record: d95b370a-243f-4e67-81ef-65a6fb321a7a {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:36:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:28 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:36:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:36:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:36:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:36:28 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:36:28 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:29 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:36:29 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:36:29 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=25.282642364501953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 2dc4b36f-5009-4241-9b22-62bcad66e70d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing inventories for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating ProviderTree inventory for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing aggregate associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, aggregates: None {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 23:36:29 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing trait associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 23:36:30 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:36:30 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:36:30 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:36:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:36:30 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:36:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 23:36:30 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] There are 0 instances to clean {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 23:36:32 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:36:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:32 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:36:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:36:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:36:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:36:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:36:32 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:36:32 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 2dc4b36f-5009-4241-9b22-62bcad66e70d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:36:33 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Updating instance_info_cache with network_info: [{"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:36:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-2dc4b36f-5009-4241-9b22-62bcad66e70d" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:36:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:36:33 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:36:33 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:36:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:36:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:35 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:36:37 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:37 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:36:37 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:36:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wuDeXJHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:36:39 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:36:39 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:36:39 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47b8ebf-793b-4dfd-9baf-b4e25b6efab4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:36:39 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ea6d56-e1ff-45de-b68b-7492d6f685c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738] added
Aug 09 23:36:39 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d534fc0f-402a-4a46-b055-d151aef79c35]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa1b86e-d608-4d2a-bb1a-d164098bdeb1]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wuDeXJHh {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wuDeXJHh" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6383ad9-c7fd-49fe-83e6-11c8bce5a2e0]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wuDeXJHh'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e93fa34-4c1c-4fab-bf67-82321bc5c238]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[577dce6a-2eea-4b7e-9cc0-bdcf13738627]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:36:39 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:36:39 user nova-compute[72409]:  {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:36:39 user nova-compute[72409]: WARNING os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 23:36:39 user nova-compute[72409]: 
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e803e588-deec-4789-affc-4b45ca22ab2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738, portal: 172.16.0.220,3260]
Aug 09 23:36:39 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738, portal: 172.16.0.220,3260] successful.
Aug 09 23:36:39 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9f976f-0bc0-4681-9938-b07849020031]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecd7a2e-b1c4-4c18-bf0f-2636cebab508]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 (non-flash)
Aug 09 23:36:39 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 (non-flash)
Aug 09 23:36:39 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:36:39 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:40 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:40 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c11d22d-fa3d-44d7-8a15-43fb57e069fd]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:40 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:36:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:36:41 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:36:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wuDeXJHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:36:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:36:41 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23932336334366264', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:36:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932336334366264', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:36:41 user nova-compute[72409]: DEBUG nova.objects.instance [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'flavor' on Instance uuid 2dc4b36f-5009-4241-9b22-62bcad66e70d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:36:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:36:41 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:36:41 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:36:41 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:36:41 user nova-compute[72409]:   <serial>262eee9c-d95c-434e-9af4-9fdddb1c1738</serial>
Aug 09 23:36:41 user nova-compute[72409]: </disk>
Aug 09 23:36:41 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:36:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:36:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:36:41 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No VIF found with MAC fa:16:3e:8c:ae:75, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:36:41 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-3fdf0aff-f990-4d33-a51f-0ee9d31aa57a tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.640s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:36:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:36:42 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:36:42 user nova-compute[72409]: INFO nova.compute.manager [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Detaching volume 262eee9c-d95c-434e-9af4-9fdddb1c1738
Aug 09 23:36:42 user nova-compute[72409]: INFO nova.virt.block_device [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Attempting to driver detach volume 262eee9c-d95c-434e-9af4-9fdddb1c1738 from mountpoint /dev/vdb
Aug 09 23:36:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Attempting to detach device vdb from instance 2dc4b36f-5009-4241-9b22-62bcad66e70d from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:36:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:36:42 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:36:42 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:36:42 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:36:42 user nova-compute[72409]:   <serial>262eee9c-d95c-434e-9af4-9fdddb1c1738</serial>
Aug 09 23:36:42 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:36:42 user nova-compute[72409]: </disk>
Aug 09 23:36:42 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:36:42 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully detached device vdb from instance 2dc4b36f-5009-4241-9b22-62bcad66e70d from the persistent domain config.
Aug 09 23:36:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2dc4b36f-5009-4241-9b22-62bcad66e70d from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:36:42 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:36:42 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:36:42 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:36:42 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:36:42 user nova-compute[72409]:   <serial>262eee9c-d95c-434e-9af4-9fdddb1c1738</serial>
Aug 09 23:36:42 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:36:42 user nova-compute[72409]: </disk>
Aug 09 23:36:42 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691624203.0677838, 2dc4b36f-5009-4241-9b22-62bcad66e70d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2dc4b36f-5009-4241-9b22-62bcad66e70d {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:36:43 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully detached device vdb from instance 2dc4b36f-5009-4241-9b22-62bcad66e70d from the live domain config.
Aug 09 23:36:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wuDeXJHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:36:43 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[732f6354-a828-40cd-be3b-f04578af883d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[572b447a-cf9e-4ba9-898e-714a6161c6f3]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 (non-flash)
Aug 09 23:36:43 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 (non-flash)
Aug 09 23:36:43 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84298310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3826a2b4-cd2e-4e45-b906-72d40fd5b065]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4016a8a-70b8-4204-a4b7-10dbea493a32]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[21399da9-59ec-4cb9-83a6-e302016fd587]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8978ab5b-2fc9-4eba-9bb7-de3c308db5a4]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f729117-60e4-4942-98d5-da34e863f68e]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93eed86-57a1-4d85-ac10-07618e4762d5]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738, portal: 172.16.0.220,3260]
Aug 09 23:36:43 user nova-compute[72409]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738, portal: 172.16.0.220,3260] successful.
Aug 09 23:36:43 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262eee9c-d95c-434e-9af4-9fdddb1c1738 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[faca9748-9be5-4b82-903c-d566d63b3c8c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] <== disconnect_volume: return (254ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:36:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:44 user nova-compute[72409]: DEBUG nova.objects.instance [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'flavor' on Instance uuid 2dc4b36f-5009-4241-9b22-62bcad66e70d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:36:44 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-1f2ba5cb-99dd-44a7-952c-06f8398a51b6 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.614s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:36:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:36:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:36:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:36:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:36:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:36:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:36:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:36:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:37:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:37:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:37:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:37:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:37:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:37:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:37:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:37:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:08 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:37:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:37:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:37:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:37:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:37:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:37:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:37:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:37:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:37:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:37:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:37:24 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:37:24 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Triggering sync for uuid 2dc4b36f-5009-4241-9b22-62bcad66e70d {{(pid=72409) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 23:37:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:37:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:37:24 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:37:24 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:37:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:37:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:37:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:37:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:37:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:30 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:37:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:37:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:37:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:37:30 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:37:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:37:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:37:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:37:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:37:31 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:37:31 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:37:31 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8834MB free_disk=25.28177261352539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:37:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:37:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:37:31 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 2dc4b36f-5009-4241-9b22-62bcad66e70d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:37:31 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:37:31 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:37:31 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:37:31 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:37:31 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:37:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:37:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:37:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:37:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:37:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:37:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:37:32 user nova-compute[72409]: INFO nova.compute.manager [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Terminating instance
Aug 09 23:37:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:37:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-a3d9ed81-03b1-474e-a405-2ac8cebcffc8 req-bf3d3686-6c9e-41bc-8fcc-430f5334d644 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Received event network-vif-unplugged-c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a3d9ed81-03b1-474e-a405-2ac8cebcffc8 req-bf3d3686-6c9e-41bc-8fcc-430f5334d644 service nova] Acquiring lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a3d9ed81-03b1-474e-a405-2ac8cebcffc8 req-bf3d3686-6c9e-41bc-8fcc-430f5334d644 service nova] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-a3d9ed81-03b1-474e-a405-2ac8cebcffc8 req-bf3d3686-6c9e-41bc-8fcc-430f5334d644 service nova] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-a3d9ed81-03b1-474e-a405-2ac8cebcffc8 req-bf3d3686-6c9e-41bc-8fcc-430f5334d644 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] No waiting events found dispatching network-vif-unplugged-c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.compute.manager [req-a3d9ed81-03b1-474e-a405-2ac8cebcffc8 req-bf3d3686-6c9e-41bc-8fcc-430f5334d644 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Received event network-vif-unplugged-c291c428-af9e-452b-813a-b978d5eef260 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:33 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Instance destroyed successfully.
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.objects.instance [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'resources' on Instance uuid 2dc4b36f-5009-4241-9b22-62bcad66e70d {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-911993736',display_name='tempest-AttachVolumeNegativeTest-server-911993736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-911993736',id=50,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC210JCk8QpVzJQbq6pXsRtJK9A5E6rGqfoKHyDD2TZkZVSpTKpRgJpuDhzIezlBIOr6+ejiof2Z8kHr3a0yz0iWftCwWs2o2oI99bCD6f+7E5LgITnVhqJXDZBySOmEw==',key_name='tempest-keypair-1288250821',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:34:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8c2a26aea0b400389c76c17af8ba663',ramdisk_id='',reservation_id='r-h757fmp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1895927455',owner_user_name='tempest-AttachVolumeNegativeTest-1895927455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17d9e59fb7444f06bd3f27c0ecf55cec',uuid=2dc4b36f-5009-4241-9b22-62bcad66e70d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converting VIF {"id": "c291c428-af9e-452b-813a-b978d5eef260", "address": "fa:16:3e:8c:ae:75", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc291c428-af", "ovs_interfaceid": "c291c428-af9e-452b-813a-b978d5eef260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ae:75,bridge_name='br-int',has_traffic_filtering=True,id=c291c428-af9e-452b-813a-b978d5eef260,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc291c428-af') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG os_vif [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ae:75,bridge_name='br-int',has_traffic_filtering=True,id=c291c428-af9e-452b-813a-b978d5eef260,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc291c428-af') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc291c428-af, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:37:33 user nova-compute[72409]: INFO os_vif [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:ae:75,bridge_name='br-int',has_traffic_filtering=True,id=c291c428-af9e-452b-813a-b978d5eef260,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc291c428-af')
Aug 09 23:37:33 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Deleting instance files /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d_del
Aug 09 23:37:33 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Deletion of /opt/stack/data/nova/instances/2dc4b36f-5009-4241-9b22-62bcad66e70d_del complete
Aug 09 23:37:33 user nova-compute[72409]: INFO nova.compute.manager [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 23:37:33 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Skipping network cache update for instance because it is being deleted. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 23:37:33 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:37:34 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:37:34 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Took 0.75 seconds to deallocate network for instance.
Aug 09 23:37:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:37:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:37:34 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:37:34 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:37:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:37:34 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Deleted allocations for instance 2dc4b36f-5009-4241-9b22-62bcad66e70d
Aug 09 23:37:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-7738c9e6-216e-4f12-bc85-97562bfc6abf tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.916s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:37:34 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:37:34 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:37:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-4fddb974-8db4-4fe2-99ad-e0ffa011f39d req-5feb007b-9b57-414b-9a60-229e2febff39 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Received event network-vif-plugged-c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:37:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4fddb974-8db4-4fe2-99ad-e0ffa011f39d req-5feb007b-9b57-414b-9a60-229e2febff39 service nova] Acquiring lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:37:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4fddb974-8db4-4fe2-99ad-e0ffa011f39d req-5feb007b-9b57-414b-9a60-229e2febff39 service nova] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:37:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4fddb974-8db4-4fe2-99ad-e0ffa011f39d req-5feb007b-9b57-414b-9a60-229e2febff39 service nova] Lock "2dc4b36f-5009-4241-9b22-62bcad66e70d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:37:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-4fddb974-8db4-4fe2-99ad-e0ffa011f39d req-5feb007b-9b57-414b-9a60-229e2febff39 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] No waiting events found dispatching network-vif-plugged-c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:37:35 user nova-compute[72409]: WARNING nova.compute.manager [req-4fddb974-8db4-4fe2-99ad-e0ffa011f39d req-5feb007b-9b57-414b-9a60-229e2febff39 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Received unexpected event network-vif-plugged-c291c428-af9e-452b-813a-b978d5eef260 for instance with vm_state deleted and task_state None.
Aug 09 23:37:35 user nova-compute[72409]: DEBUG nova.compute.manager [req-4fddb974-8db4-4fe2-99ad-e0ffa011f39d req-5feb007b-9b57-414b-9a60-229e2febff39 service nova] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Received event network-vif-deleted-c291c428-af9e-452b-813a-b978d5eef260 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:37:37 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:37:38 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:38 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:37:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:37:43 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:37:48 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691624253.6219049, 2dc4b36f-5009-4241-9b22-62bcad66e70d => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:37:48 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] VM Stopped (Lifecycle Event)
Aug 09 23:37:48 user nova-compute[72409]: DEBUG nova.compute.manager [None req-065d1f83-a5f5-4aac-bac3-906fa5306b1a None None] [instance: 2dc4b36f-5009-4241-9b22-62bcad66e70d] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:37:48 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:37:53 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:37:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:37:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:37:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:37:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:37:58 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:03 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:08 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:38:13 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:18 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:38:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:38:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:38:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:38:26 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Starting instance... {{(pid=72409) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 23:38:26 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:38:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:38:26 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:38:26 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72409) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 23:38:26 user nova-compute[72409]: INFO nova.compute.claims [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Claim successful on node user
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Start building networks asynchronously for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Allocating IP information in the background. {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] allocate_for_instance() {{(pid=72409) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 23:38:27 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Start building block device mappings for instance. {{(pid=72409) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.policy [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17d9e59fb7444f06bd3f27c0ecf55cec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8c2a26aea0b400389c76c17af8ba663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72409) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Start spawning the instance on the hypervisor. {{(pid=72409) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Creating instance directory {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 23:38:27 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Creating image(s)
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "/opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "/opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "/opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.139s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk 1073741824 {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e,backing_fmt=raw /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk 1073741824" returned: 0 in 0.052s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "258aaa65927ef7cee1bfa6c49848a769eed3ea4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/258aaa65927ef7cee1bfa6c49848a769eed3ea4e --force-share --output=json" returned: 0 in 0.140s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk. size=1073741824 {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Successfully created port: dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.virt.disk.api [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Cannot resize image /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk to a smaller size. {{(pid=72409) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'migration_context' on Instance uuid 99ebe55d-7c0e-4287-b60a-25027a0c3b90 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Created local disks {{(pid=72409) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Ensure instance console log exists: /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/console.log {{(pid=72409) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:38:27 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Successfully updated port: dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquired lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Building network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-b5845dbe-c032-4e13-9a52-5ff2181294b4 req-36db912f-ccfe-4ba1-9d75-280ac56b079a service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Received event network-changed-dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.compute.manager [req-b5845dbe-c032-4e13-9a52-5ff2181294b4 req-36db912f-ccfe-4ba1-9d75-280ac56b079a service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Refreshing instance network info cache due to event network-changed-dcc2a81c-89eb-4197-9265-f765af0c3ee1. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b5845dbe-c032-4e13-9a52-5ff2181294b4 req-36db912f-ccfe-4ba1-9d75-280ac56b079a service nova] Acquiring lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Instance cache missing network info. {{(pid=72409) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.network.neutron [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updating instance_info_cache with network_info: [{"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Releasing lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Instance network_info: |[{"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72409) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b5845dbe-c032-4e13-9a52-5ff2181294b4 req-36db912f-ccfe-4ba1-9d75-280ac56b079a service nova] Acquired lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.network.neutron [req-b5845dbe-c032-4e13-9a52-5ff2181294b4 req-36db912f-ccfe-4ba1-9d75-280ac56b079a service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Refreshing network info cache for port dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Start _get_guest_xml network_info=[{"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'disk_bus': 'virtio', 'guest_format': None, 'image_id': '1f9d9956-e987-40f0-9bbf-df1fe47ca751'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 23:38:28 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:38:28 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CPU controller missing on host. {{(pid=72409) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.host [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CPU controller found on host. {{(pid=72409) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72409) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T22:45:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T22:46:10Z,direct_url=<?>,disk_format='qcow2',id=1f9d9956-e987-40f0-9bbf-df1fe47ca751,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1eb3465793574a31b89a7979a72d4df9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T22:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Flavor limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Image limits 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Flavor pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Image pref 0:0:0 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Got 1 possible topologies {{(pid=72409) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 23:38:28 user nova-compute[72409]: DEBUG nova.virt.hardware [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72409) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:38:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1520593831',display_name='tempest-AttachVolumeNegativeTest-server-1520593831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1520593831',id=51,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHbXfiovYuZIenMFPP/IyXxu3dz1fxkrfL388IayItkesbrLpSKd+/1TgDyqcgdPCmw4z7lR9ECXxOO8o9MeW9tInY++YIqQpkQ4TW+vmCvCMn0ONZLFQszwyWrTwiAjg==',key_name='tempest-keypair-1597561873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8c2a26aea0b400389c76c17af8ba663',ramdisk_id='',reservation_id='r-aut04y9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1895927455',owner_user_name='tempest-AttachVolumeNegativeTest-1895927455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17d9e59fb7444f06bd3f27c0ecf55cec',uuid=99ebe55d-7c0e-4287-b60a-25027a0c3b90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72409) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converting VIF {"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:57:99,bridge_name='br-int',has_traffic_filtering=True,id=dcc2a81c-89eb-4197-9265-f765af0c3ee1,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc2a81c-89') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG nova.objects.instance [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'pci_devices' on Instance uuid 99ebe55d-7c0e-4287-b60a-25027a0c3b90 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] End _get_guest_xml xml=<domain type="kvm">
Aug 09 23:38:29 user nova-compute[72409]:   <uuid>99ebe55d-7c0e-4287-b60a-25027a0c3b90</uuid>
Aug 09 23:38:29 user nova-compute[72409]:   <name>instance-00000033</name>
Aug 09 23:38:29 user nova-compute[72409]:   <memory>524288</memory>
Aug 09 23:38:29 user nova-compute[72409]:   <vcpu>1</vcpu>
Aug 09 23:38:29 user nova-compute[72409]:   <metadata>
Aug 09 23:38:29 user nova-compute[72409]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 23:38:29 user nova-compute[72409]:       <nova:package version="0.0.0"/>
Aug 09 23:38:29 user nova-compute[72409]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1520593831</nova:name>
Aug 09 23:38:29 user nova-compute[72409]:       <nova:creationTime>2023-08-09 23:38:28</nova:creationTime>
Aug 09 23:38:29 user nova-compute[72409]:       <nova:flavor name="m1.tiny">
Aug 09 23:38:29 user nova-compute[72409]:         <nova:memory>512</nova:memory>
Aug 09 23:38:29 user nova-compute[72409]:         <nova:disk>1</nova:disk>
Aug 09 23:38:29 user nova-compute[72409]:         <nova:swap>0</nova:swap>
Aug 09 23:38:29 user nova-compute[72409]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 23:38:29 user nova-compute[72409]:         <nova:vcpus>1</nova:vcpus>
Aug 09 23:38:29 user nova-compute[72409]:       </nova:flavor>
Aug 09 23:38:29 user nova-compute[72409]:       <nova:owner>
Aug 09 23:38:29 user nova-compute[72409]:         <nova:user uuid="17d9e59fb7444f06bd3f27c0ecf55cec">tempest-AttachVolumeNegativeTest-1895927455-project-member</nova:user>
Aug 09 23:38:29 user nova-compute[72409]:         <nova:project uuid="f8c2a26aea0b400389c76c17af8ba663">tempest-AttachVolumeNegativeTest-1895927455</nova:project>
Aug 09 23:38:29 user nova-compute[72409]:       </nova:owner>
Aug 09 23:38:29 user nova-compute[72409]:       <nova:root type="image" uuid="1f9d9956-e987-40f0-9bbf-df1fe47ca751"/>
Aug 09 23:38:29 user nova-compute[72409]:       <nova:ports>
Aug 09 23:38:29 user nova-compute[72409]:         <nova:port uuid="dcc2a81c-89eb-4197-9265-f765af0c3ee1">
Aug 09 23:38:29 user nova-compute[72409]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 23:38:29 user nova-compute[72409]:         </nova:port>
Aug 09 23:38:29 user nova-compute[72409]:       </nova:ports>
Aug 09 23:38:29 user nova-compute[72409]:     </nova:instance>
Aug 09 23:38:29 user nova-compute[72409]:   </metadata>
Aug 09 23:38:29 user nova-compute[72409]:   <sysinfo type="smbios">
Aug 09 23:38:29 user nova-compute[72409]:     <system>
Aug 09 23:38:29 user nova-compute[72409]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 23:38:29 user nova-compute[72409]:       <entry name="product">OpenStack Nova</entry>
Aug 09 23:38:29 user nova-compute[72409]:       <entry name="version">0.0.0</entry>
Aug 09 23:38:29 user nova-compute[72409]:       <entry name="serial">99ebe55d-7c0e-4287-b60a-25027a0c3b90</entry>
Aug 09 23:38:29 user nova-compute[72409]:       <entry name="uuid">99ebe55d-7c0e-4287-b60a-25027a0c3b90</entry>
Aug 09 23:38:29 user nova-compute[72409]:       <entry name="family">Virtual Machine</entry>
Aug 09 23:38:29 user nova-compute[72409]:     </system>
Aug 09 23:38:29 user nova-compute[72409]:   </sysinfo>
Aug 09 23:38:29 user nova-compute[72409]:   <os>
Aug 09 23:38:29 user nova-compute[72409]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 23:38:29 user nova-compute[72409]:     <boot dev="hd"/>
Aug 09 23:38:29 user nova-compute[72409]:     <smbios mode="sysinfo"/>
Aug 09 23:38:29 user nova-compute[72409]:   </os>
Aug 09 23:38:29 user nova-compute[72409]:   <features>
Aug 09 23:38:29 user nova-compute[72409]:     <acpi/>
Aug 09 23:38:29 user nova-compute[72409]:     <apic/>
Aug 09 23:38:29 user nova-compute[72409]:     <vmcoreinfo/>
Aug 09 23:38:29 user nova-compute[72409]:   </features>
Aug 09 23:38:29 user nova-compute[72409]:   <clock offset="utc">
Aug 09 23:38:29 user nova-compute[72409]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 23:38:29 user nova-compute[72409]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 23:38:29 user nova-compute[72409]:     <timer name="hpet" present="no"/>
Aug 09 23:38:29 user nova-compute[72409]:   </clock>
Aug 09 23:38:29 user nova-compute[72409]:   <cpu mode="custom" match="exact">
Aug 09 23:38:29 user nova-compute[72409]:     <model>Nehalem</model>
Aug 09 23:38:29 user nova-compute[72409]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 23:38:29 user nova-compute[72409]:   </cpu>
Aug 09 23:38:29 user nova-compute[72409]:   <devices>
Aug 09 23:38:29 user nova-compute[72409]:     <disk type="file" device="disk">
Aug 09 23:38:29 user nova-compute[72409]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 23:38:29 user nova-compute[72409]:       <source file="/opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk"/>
Aug 09 23:38:29 user nova-compute[72409]:       <target dev="vda" bus="virtio"/>
Aug 09 23:38:29 user nova-compute[72409]:     </disk>
Aug 09 23:38:29 user nova-compute[72409]:     <interface type="ethernet">
Aug 09 23:38:29 user nova-compute[72409]:       <mac address="fa:16:3e:93:57:99"/>
Aug 09 23:38:29 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:38:29 user nova-compute[72409]:       <mtu size="1442"/>
Aug 09 23:38:29 user nova-compute[72409]:       <target dev="tapdcc2a81c-89"/>
Aug 09 23:38:29 user nova-compute[72409]:     </interface>
Aug 09 23:38:29 user nova-compute[72409]:     <serial type="pty">
Aug 09 23:38:29 user nova-compute[72409]:       <log file="/opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/console.log" append="off"/>
Aug 09 23:38:29 user nova-compute[72409]:     </serial>
Aug 09 23:38:29 user nova-compute[72409]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 23:38:29 user nova-compute[72409]:     <video>
Aug 09 23:38:29 user nova-compute[72409]:       <model type="virtio"/>
Aug 09 23:38:29 user nova-compute[72409]:     </video>
Aug 09 23:38:29 user nova-compute[72409]:     <rng model="virtio">
Aug 09 23:38:29 user nova-compute[72409]:       <backend model="random">/dev/urandom</backend>
Aug 09 23:38:29 user nova-compute[72409]:     </rng>
Aug 09 23:38:29 user nova-compute[72409]:     <controller type="usb" index="0" model="none"/>
Aug 09 23:38:29 user nova-compute[72409]:     <memballoon model="virtio">
Aug 09 23:38:29 user nova-compute[72409]:       <stats period="10"/>
Aug 09 23:38:29 user nova-compute[72409]:     </memballoon>
Aug 09 23:38:29 user nova-compute[72409]:   </devices>
Aug 09 23:38:29 user nova-compute[72409]: </domain>
Aug 09 23:38:29 user nova-compute[72409]:  {{(pid=72409) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:38:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1520593831',display_name='tempest-AttachVolumeNegativeTest-server-1520593831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1520593831',id=51,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHbXfiovYuZIenMFPP/IyXxu3dz1fxkrfL388IayItkesbrLpSKd+/1TgDyqcgdPCmw4z7lR9ECXxOO8o9MeW9tInY++YIqQpkQ4TW+vmCvCMn0ONZLFQszwyWrTwiAjg==',key_name='tempest-keypair-1597561873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8c2a26aea0b400389c76c17af8ba663',ramdisk_id='',reservation_id='r-aut04y9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1895927455',owner_user_name='tempest-AttachVolumeNegativeTest-1895927455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T23:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17d9e59fb7444f06bd3f27c0ecf55cec',uuid=99ebe55d-7c0e-4287-b60a-25027a0c3b90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converting VIF {"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:57:99,bridge_name='br-int',has_traffic_filtering=True,id=dcc2a81c-89eb-4197-9265-f765af0c3ee1,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc2a81c-89') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG os_vif [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:57:99,bridge_name='br-int',has_traffic_filtering=True,id=dcc2a81c-89eb-4197-9265-f765af0c3ee1,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc2a81c-89') {{(pid=72409) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcc2a81c-89, may_exist=True, interface_attrs={}) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdcc2a81c-89, col_values=(('external_ids', {'iface-id': 'dcc2a81c-89eb-4197-9265-f765af0c3ee1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:57:99', 'vm-uuid': '99ebe55d-7c0e-4287-b60a-25027a0c3b90'}),), if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:29 user nova-compute[72409]: INFO os_vif [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:57:99,bridge_name='br-int',has_traffic_filtering=True,id=dcc2a81c-89eb-4197-9265-f765af0c3ee1,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc2a81c-89')
Aug 09 23:38:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No VIF found with MAC fa:16:3e:93:57:99, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG nova.network.neutron [req-b5845dbe-c032-4e13-9a52-5ff2181294b4 req-36db912f-ccfe-4ba1-9d75-280ac56b079a service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updated VIF entry in instance network info cache for port dcc2a81c-89eb-4197-9265-f765af0c3ee1. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG nova.network.neutron [req-b5845dbe-c032-4e13-9a52-5ff2181294b4 req-36db912f-ccfe-4ba1-9d75-280ac56b079a service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updating instance_info_cache with network_info: [{"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:38:29 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-b5845dbe-c032-4e13-9a52-5ff2181294b4 req-36db912f-ccfe-4ba1-9d75-280ac56b079a service nova] Releasing lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:38:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-e1848eda-5223-437a-957c-d6f4bfbb2704 req-013c9bd4-8c1c-4d89-a0ed-801d54834a88 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Received event network-vif-plugged-dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:38:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e1848eda-5223-437a-957c-d6f4bfbb2704 req-013c9bd4-8c1c-4d89-a0ed-801d54834a88 service nova] Acquiring lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:38:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e1848eda-5223-437a-957c-d6f4bfbb2704 req-013c9bd4-8c1c-4d89-a0ed-801d54834a88 service nova] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:38:30 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-e1848eda-5223-437a-957c-d6f4bfbb2704 req-013c9bd4-8c1c-4d89-a0ed-801d54834a88 service nova] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:38:30 user nova-compute[72409]: DEBUG nova.compute.manager [req-e1848eda-5223-437a-957c-d6f4bfbb2704 req-013c9bd4-8c1c-4d89-a0ed-801d54834a88 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] No waiting events found dispatching network-vif-plugged-dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:38:30 user nova-compute[72409]: WARNING nova.compute.manager [req-e1848eda-5223-437a-957c-d6f4bfbb2704 req-013c9bd4-8c1c-4d89-a0ed-801d54834a88 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Received unexpected event network-vif-plugged-dcc2a81c-89eb-4197-9265-f765af0c3ee1 for instance with vm_state building and task_state spawning.
Aug 09 23:38:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:30 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:38:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:38:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:38:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:38:31 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:38:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691624312.3835285, 99ebe55d-7c0e-4287-b60a-25027a0c3b90 => Resumed> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:38:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] VM Resumed (Lifecycle Event)
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Instance event wait completed in 0 seconds for  {{(pid=72409) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Guest created on hypervisor {{(pid=72409) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 23:38:32 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:38:32 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8907MB free_disk=25.307865142822266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:38:32 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Instance spawned successfully.
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Found default for hw_cdrom_bus of ide {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Found default for hw_disk_bus of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Found default for hw_input_bus of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Found default for hw_pointer_model of None {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Found default for hw_video_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Found default for hw_vif_model of virtio {{(pid=72409) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 23:38:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.virt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Emitting event <LifecycleEvent: 1691624312.3849874, 99ebe55d-7c0e-4287-b60a-25027a0c3b90 => Started> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:38:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] VM Started (Lifecycle Event)
Aug 09 23:38:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72409) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 23:38:32 user nova-compute[72409]: INFO nova.compute.manager [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 99ebe55d-7c0e-4287-b60a-25027a0c3b90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-4c465101-4483-4075-a9e8-e33163b426d7 req-74fa6b7e-8b7a-4808-a882-822368221427 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Received event network-vif-plugged-dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4c465101-4483-4075-a9e8-e33163b426d7 req-74fa6b7e-8b7a-4808-a882-822368221427 service nova] Acquiring lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4c465101-4483-4075-a9e8-e33163b426d7 req-74fa6b7e-8b7a-4808-a882-822368221427 service nova] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-4c465101-4483-4075-a9e8-e33163b426d7 req-74fa6b7e-8b7a-4808-a882-822368221427 service nova] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.manager [req-4c465101-4483-4075-a9e8-e33163b426d7 req-74fa6b7e-8b7a-4808-a882-822368221427 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] No waiting events found dispatching network-vif-plugged-dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:38:32 user nova-compute[72409]: WARNING nova.compute.manager [req-4c465101-4483-4075-a9e8-e33163b426d7 req-74fa6b7e-8b7a-4808-a882-822368221427 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Received unexpected event network-vif-plugged-dcc2a81c-89eb-4197-9265-f765af0c3ee1 for instance with vm_state building and task_state spawning.
Aug 09 23:38:32 user nova-compute[72409]: INFO nova.compute.manager [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Took 5.44 seconds to spawn the instance on the hypervisor.
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.manager [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:38:32 user nova-compute[72409]: INFO nova.compute.manager [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Took 5.96 seconds to build instance.
Aug 09 23:38:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-2a08a077-14f2-4cce-af63-142dab766474 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.050s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:38:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:38:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:35 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:38:35 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:38:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:38:35 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:38:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:38:35 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:38:35 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:38:35 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 99ebe55d-7c0e-4287-b60a-25027a0c3b90 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:38:36 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updating instance_info_cache with network_info: [{"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:38:36 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:38:36 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:38:36 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:38:36 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:38:36 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:38:37 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:38:38 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:38:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:39 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:38:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:38:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:47 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:57 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:38:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:39:02 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:39:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:39:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:39:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:39:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:39:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:39:26 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:39:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:39:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:39:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:39:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:39:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:39:31 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:39:31 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:39:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:39:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:39:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:39:32 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:39:32 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:39:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8822MB free_disk=25.271503448486328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:39:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:39:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:39:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 99ebe55d-7c0e-4287-b60a-25027a0c3b90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:39:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:39:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:39:32 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:39:32 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:39:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:39:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:39:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:39:37 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:39:37 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:39:37 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:39:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:39:37 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:39:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:39:37 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:39:37 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:39:37 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 99ebe55d-7c0e-4287-b60a-25027a0c3b90 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:39:38 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updating instance_info_cache with network_info: [{"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:39:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:39:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:39:38 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:39:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:39:38 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:39:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:39:39 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:39:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:39:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:39:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:39:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:39:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:18 user nova-compute[72409]: DEBUG nova.compute.manager [req-0b4733d1-4d76-4307-8b8b-eaab79198166 req-50c8684c-1dd6-4e61-bfdb-f3c9095a0f33 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Received event network-changed-dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:40:18 user nova-compute[72409]: DEBUG nova.compute.manager [req-0b4733d1-4d76-4307-8b8b-eaab79198166 req-50c8684c-1dd6-4e61-bfdb-f3c9095a0f33 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Refreshing instance network info cache due to event network-changed-dcc2a81c-89eb-4197-9265-f765af0c3ee1. {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 23:40:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0b4733d1-4d76-4307-8b8b-eaab79198166 req-50c8684c-1dd6-4e61-bfdb-f3c9095a0f33 service nova] Acquiring lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:40:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0b4733d1-4d76-4307-8b8b-eaab79198166 req-50c8684c-1dd6-4e61-bfdb-f3c9095a0f33 service nova] Acquired lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:40:18 user nova-compute[72409]: DEBUG nova.network.neutron [req-0b4733d1-4d76-4307-8b8b-eaab79198166 req-50c8684c-1dd6-4e61-bfdb-f3c9095a0f33 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Refreshing network info cache for port dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 23:40:18 user nova-compute[72409]: DEBUG nova.network.neutron [req-0b4733d1-4d76-4307-8b8b-eaab79198166 req-50c8684c-1dd6-4e61-bfdb-f3c9095a0f33 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updated VIF entry in instance network info cache for port dcc2a81c-89eb-4197-9265-f765af0c3ee1. {{(pid=72409) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 23:40:18 user nova-compute[72409]: DEBUG nova.network.neutron [req-0b4733d1-4d76-4307-8b8b-eaab79198166 req-50c8684c-1dd6-4e61-bfdb-f3c9095a0f33 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updating instance_info_cache with network_info: [{"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:40:18 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-0b4733d1-4d76-4307-8b8b-eaab79198166 req-50c8684c-1dd6-4e61-bfdb-f3c9095a0f33 service nova] Releasing lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:40:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:40:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:40:21 user nova-compute[72409]: DEBUG nova.objects.instance [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'flavor' on Instance uuid 99ebe55d-7c0e-4287-b60a-25027a0c3b90 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:40:21 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:40:22 user nova-compute[72409]: INFO nova.compute.manager [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Attaching volume 46472675-78ba-4e9a-98f1-e144dfd3ff6b to /dev/vdb
Aug 09 23:40:22 user nova-compute[72409]: DEBUG os_brick.utils [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c313042-7f73-4320-ad8f-852dfdbccd4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b28ec809aa\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3367dd7b-ea13-4413-afe8-820dfca5296c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c2a6b9-ab71-489e-bd90-3657d8cbe0b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6121570e-3beb-486e-9421-1fd5a89b9003]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Running cmd (subprocess): nvme version {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] 'nvme version' failed. Not Retrying. {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.nvmeof [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] nvme not present on system {{(pid=72409) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 23:40:22 user nova-compute[72409]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 23:40:22 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[1396efa3-a380-4534-97d8-c10318fe5add]: (4, '') {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72409) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.lightos [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] LIGHTOS: no hostnqn found. {{(pid=72409) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG os_brick.utils [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b28ec809aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG nova.virt.block_device [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updating existing volume attachment record: 9bfec71b-d4e2-4d04-8a42-62c45844519d {{(pid=72409) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 23:40:22 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:27 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:28 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:40:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Calling os-brick to attach iSCSI Volume {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNXhvQdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:40:30 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:40:30 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:40:30 user nova-compute[72409]: INFO os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b43fa0-43d9-42e3-b744-aca7dc54ed1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 23:40:30 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --interface default --op new {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1604837-414a-4ff6-b600-b5a784af2076]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b] added\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b] added
Aug 09 23:40:30 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afd22f2-3ae6-4476-9a68-50b86dbb8810]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c6adf6-f7e0-49e4-97a4-84e3a147d1f3]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNXhvQdw {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNXhvQdw" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffb368b-0406-4cfe-ab1d-733681c9773c]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yNXhvQdw'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb2a4b5-e886-4c2b-bcb4-50bba06fe8b7]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd935f7-5cef-4c5f-8c22-7ddb0b1ac072]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:40:30 user nova-compute[72409]:  {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 23:40:30 user nova-compute[72409]:  {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:40:30 user nova-compute[72409]: WARNING os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 23:40:30 user nova-compute[72409]: 
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --login {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2186692-315d-4136-9d73-9d2b43eceb00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b, portal: 172.16.0.220,3260]
Aug 09 23:40:30 user nova-compute[72409]: Login to [iface: default, target: iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b, portal: 172.16.0.220,3260] successful.
Aug 09 23:40:30 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d2586d-8168-405d-bb85-73b6a73c0554]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfea3a28-e056-46cc-8b90-463934d3f304]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b (non-flash)
Aug 09 23:40:30 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b (non-flash)
Aug 09 23:40:30 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Connected to 172.16.0.220:3260 {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72409) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72409) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[897a6f1c-ea4f-4775-98d5-87533a7b4ec5]: (4, ('- - 0', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:30 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:40:31 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72409) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 23:40:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNXhvQdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72409) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 23:40:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:40:31 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23839613931393736', 'path': '/dev/sdb'} {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:40:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839613931393736', 'path': '/dev/sdb'} {{(pid=72409) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 23:40:31 user nova-compute[72409]: DEBUG nova.objects.instance [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'flavor' on Instance uuid 99ebe55d-7c0e-4287-b60a-25027a0c3b90 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:40:31 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 23:40:31 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:40:31 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:40:31 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:40:31 user nova-compute[72409]:   <serial>46472675-78ba-4e9a-98f1-e144dfd3ff6b</serial>
Aug 09 23:40:31 user nova-compute[72409]: </disk>
Aug 09 23:40:31 user nova-compute[72409]:  {{(pid=72409) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 23:40:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:40:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:40:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:40:31 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:40:31 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No BDM found with device name vda, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72409) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] No VIF found with MAC fa:16:3e:93:57:99, not building metadata {{(pid=72409) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-847be864-97b0-42d4-9922-cfe6411ae8b2 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.423s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72409) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72409) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:32 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:40:32 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:40:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=25.270557403564453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Instance 99ebe55d-7c0e-4287-b60a-25027a0c3b90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72409) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:40:32 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:40:33 user nova-compute[72409]: INFO nova.compute.manager [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Detaching volume 46472675-78ba-4e9a-98f1-e144dfd3ff6b
Aug 09 23:40:33 user nova-compute[72409]: INFO nova.virt.block_device [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Attempting to driver detach volume 46472675-78ba-4e9a-98f1-e144dfd3ff6b from mountpoint /dev/vdb
Aug 09 23:40:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Attempting to detach device vdb from instance 99ebe55d-7c0e-4287-b60a-25027a0c3b90 from the persistent domain config. {{(pid=72409) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:40:33 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:40:33 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:40:33 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:40:33 user nova-compute[72409]:   <serial>46472675-78ba-4e9a-98f1-e144dfd3ff6b</serial>
Aug 09 23:40:33 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:40:33 user nova-compute[72409]: </disk>
Aug 09 23:40:33 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:40:33 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully detached device vdb from instance 99ebe55d-7c0e-4287-b60a-25027a0c3b90 from the persistent domain config.
Aug 09 23:40:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99ebe55d-7c0e-4287-b60a-25027a0c3b90 from the live domain config. {{(pid=72409) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.guest [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 23:40:33 user nova-compute[72409]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 23:40:33 user nova-compute[72409]:   <source dev="/dev/sdb"/>
Aug 09 23:40:33 user nova-compute[72409]:   <target dev="vdb" bus="virtio"/>
Aug 09 23:40:33 user nova-compute[72409]:   <serial>46472675-78ba-4e9a-98f1-e144dfd3ff6b</serial>
Aug 09 23:40:33 user nova-compute[72409]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 23:40:33 user nova-compute[72409]: </disk>
Aug 09 23:40:33 user nova-compute[72409]:  {{(pid=72409) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-d32a83bd-49af-4688-b017-c581c71237a2 None None] Received event <DeviceRemovedEvent: 1691624433.7983418, 99ebe55d-7c0e-4287-b60a-25027a0c3b90 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72409) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.driver [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99ebe55d-7c0e-4287-b60a-25027a0c3b90 {{(pid=72409) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 23:40:33 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully detached device vdb from instance 99ebe55d-7c0e-4287-b60a-25027a0c3b90 from the live domain config.
Aug 09 23:40:33 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] calling os-brick to detach iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4e9c1ed810>, {'target_iqns': ['iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNXhvQdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 23:40:33 user nova-compute[72409]: WARNING os_brick.initiator.connectors.base [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b', 0)] {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[08484a1f-bdcc-49a5-9f23-c5ff6a9dc030]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c3cc06-4890-4345-ab22-a7b541c1fa3d]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b (non-flash)\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b (non-flash)
Aug 09 23:40:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b (non-flash)
Aug 09 23:40:33 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4e84276b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b'): ({'sdb'}, set())}) {{(pid=72409) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Removing single pathed devices sdb {{(pid=72409) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[980345e4-5dae-4d73-9e16-2ed9f43590aa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[57153aff-b952-4df9-bfee-6bcd9e6107fc]: (4, ('ok\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Flushing IO for device /dev/sdb {{(pid=72409) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e305cc3c-6474-46e0-8f99-4d63243ff3bf]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72409) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca474a85-fa10-463c-a4e0-99c1264adf7d]: (4, ('1', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.linuxscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] SCSI volumes sdb have been removed. {{(pid=72409) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b')] {{(pid=72409) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:33 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2e884f-7803-4bef-8b50-362b942ca46f]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --logout {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30fb670-b96d-4b0e-a1f8-be519a1c5133]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b, portal: 172.16.0.220,3260]
Aug 09 23:40:34 user nova-compute[72409]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b, portal: 172.16.0.220,3260] successful.
Aug 09 23:40:34 user nova-compute[72409]:  stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op delete {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46472675-78ba-4e9a-98f1-e144dfd3ff6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83250) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5c8afa-513d-40da-acf4-05a6b1b445c8]: (4, ('', '')) {{(pid=83250) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72409) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.base [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] <== disconnect_volume: return (265ms) None {{(pid=72409) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Disconnected iSCSI Volume {{(pid=72409) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG nova.objects.instance [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'flavor' on Instance uuid 99ebe55d-7c0e-4287-b60a-25027a0c3b90 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:40:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-bae7588c-13c8-487b-b031-d8b99c194f31 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.614s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquired lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Forcefully refreshing network info cache for instance {{(pid=72409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG nova.objects.instance [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lazy-loading 'info_cache' on Instance uuid 99ebe55d-7c0e-4287-b60a-25027a0c3b90 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG nova.network.neutron [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updating instance_info_cache with network_info: [{"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Releasing lock "refresh_cache-99ebe55d-7c0e-4287-b60a-25027a0c3b90" {{(pid=72409) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updated the network info_cache for instance {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:40:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:40:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:40:39 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:40:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:40:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:44 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:40:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:52 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:40:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:41:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:41:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:41:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:41:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:20 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:41:20 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72409) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:41:23 user nova-compute[72409]: INFO nova.compute.manager [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Terminating instance
Aug 09 23:41:23 user nova-compute[72409]: DEBUG nova.compute.manager [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Start destroying the instance on the hypervisor. {{(pid=72409) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-bfcd91b7-1ba3-410e-85d6-ae55e41d5e37 req-fd78af06-cebe-4cbd-beaf-267683995ed2 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Received event network-vif-unplugged-dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bfcd91b7-1ba3-410e-85d6-ae55e41d5e37 req-fd78af06-cebe-4cbd-beaf-267683995ed2 service nova] Acquiring lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bfcd91b7-1ba3-410e-85d6-ae55e41d5e37 req-fd78af06-cebe-4cbd-beaf-267683995ed2 service nova] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-bfcd91b7-1ba3-410e-85d6-ae55e41d5e37 req-fd78af06-cebe-4cbd-beaf-267683995ed2 service nova] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-bfcd91b7-1ba3-410e-85d6-ae55e41d5e37 req-fd78af06-cebe-4cbd-beaf-267683995ed2 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] No waiting events found dispatching network-vif-unplugged-dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:41:23 user nova-compute[72409]: DEBUG nova.compute.manager [req-bfcd91b7-1ba3-410e-85d6-ae55e41d5e37 req-fd78af06-cebe-4cbd-beaf-267683995ed2 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Received event network-vif-unplugged-dcc2a81c-89eb-4197-9265-f765af0c3ee1 for instance with task_state deleting. {{(pid=72409) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:24 user nova-compute[72409]: INFO nova.virt.libvirt.driver [-] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Instance destroyed successfully.
Aug 09 23:41:24 user nova-compute[72409]: DEBUG nova.objects.instance [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lazy-loading 'resources' on Instance uuid 99ebe55d-7c0e-4287-b60a-25027a0c3b90 {{(pid=72409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG nova.virt.libvirt.vif [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T23:38:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1520593831',display_name='tempest-AttachVolumeNegativeTest-server-1520593831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1520593831',id=51,image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHbXfiovYuZIenMFPP/IyXxu3dz1fxkrfL388IayItkesbrLpSKd+/1TgDyqcgdPCmw4z7lR9ECXxOO8o9MeW9tInY++YIqQpkQ4TW+vmCvCMn0ONZLFQszwyWrTwiAjg==',key_name='tempest-keypair-1597561873',keypairs=<?>,launch_index=0,launched_at=2023-08-09T23:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8c2a26aea0b400389c76c17af8ba663',ramdisk_id='',reservation_id='r-aut04y9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f9d9956-e987-40f0-9bbf-df1fe47ca751',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1895927455',owner_user_name='tempest-AttachVolumeNegativeTest-1895927455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T23:38:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17d9e59fb7444f06bd3f27c0ecf55cec',uuid=99ebe55d-7c0e-4287-b60a-25027a0c3b90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converting VIF {"id": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "address": "fa:16:3e:93:57:99", "network": {"id": "f64f3d01-0e37-4e37-8862-7334f7dd9407", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1582807656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8c2a26aea0b400389c76c17af8ba663", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc2a81c-89", "ovs_interfaceid": "dcc2a81c-89eb-4197-9265-f765af0c3ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG nova.network.os_vif_util [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:57:99,bridge_name='br-int',has_traffic_filtering=True,id=dcc2a81c-89eb-4197-9265-f765af0c3ee1,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc2a81c-89') {{(pid=72409) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG os_vif [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:57:99,bridge_name='br-int',has_traffic_filtering=True,id=dcc2a81c-89eb-4197-9265-f765af0c3ee1,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc2a81c-89') {{(pid=72409) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcc2a81c-89, bridge=br-int, if_exists=True) {{(pid=72409) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:41:24 user nova-compute[72409]: INFO os_vif [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:57:99,bridge_name='br-int',has_traffic_filtering=True,id=dcc2a81c-89eb-4197-9265-f765af0c3ee1,network=Network(f64f3d01-0e37-4e37-8862-7334f7dd9407),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc2a81c-89')
Aug 09 23:41:24 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Deleting instance files /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90_del
Aug 09 23:41:24 user nova-compute[72409]: INFO nova.virt.libvirt.driver [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Deletion of /opt/stack/data/nova/instances/99ebe55d-7c0e-4287-b60a-25027a0c3b90_del complete
Aug 09 23:41:24 user nova-compute[72409]: INFO nova.compute.manager [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 23:41:24 user nova-compute[72409]: DEBUG oslo.service.loopingcall [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72409) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG nova.compute.manager [-] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Deallocating network for instance {{(pid=72409) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 23:41:24 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] deallocate_for_instance() {{(pid=72409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 23:41:25 user nova-compute[72409]: DEBUG nova.network.neutron [-] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Updating instance_info_cache with network_info: [] {{(pid=72409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 23:41:25 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Took 0.89 seconds to deallocate network for instance.
Aug 09 23:41:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:41:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:41:25 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:41:25 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:41:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.101s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:41:25 user nova-compute[72409]: INFO nova.scheduler.client.report [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Deleted allocations for instance 99ebe55d-7c0e-4287-b60a-25027a0c3b90
Aug 09 23:41:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-8120518b-f001-44a4-945c-1a5601151691 tempest-AttachVolumeNegativeTest-1895927455 tempest-AttachVolumeNegativeTest-1895927455-project-member] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.037s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:41:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-85e9ed73-6227-4eeb-a417-cfeaae045ce7 req-1f4a0b32-3a2d-450c-8adc-435ce3e6a4e3 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Received event network-vif-plugged-dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:41:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-85e9ed73-6227-4eeb-a417-cfeaae045ce7 req-1f4a0b32-3a2d-450c-8adc-435ce3e6a4e3 service nova] Acquiring lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:41:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-85e9ed73-6227-4eeb-a417-cfeaae045ce7 req-1f4a0b32-3a2d-450c-8adc-435ce3e6a4e3 service nova] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:41:25 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [req-85e9ed73-6227-4eeb-a417-cfeaae045ce7 req-1f4a0b32-3a2d-450c-8adc-435ce3e6a4e3 service nova] Lock "99ebe55d-7c0e-4287-b60a-25027a0c3b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:41:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-85e9ed73-6227-4eeb-a417-cfeaae045ce7 req-1f4a0b32-3a2d-450c-8adc-435ce3e6a4e3 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] No waiting events found dispatching network-vif-plugged-dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 23:41:25 user nova-compute[72409]: WARNING nova.compute.manager [req-85e9ed73-6227-4eeb-a417-cfeaae045ce7 req-1f4a0b32-3a2d-450c-8adc-435ce3e6a4e3 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Received unexpected event network-vif-plugged-dcc2a81c-89eb-4197-9265-f765af0c3ee1 for instance with vm_state deleted and task_state None.
Aug 09 23:41:25 user nova-compute[72409]: DEBUG nova.compute.manager [req-85e9ed73-6227-4eeb-a417-cfeaae045ce7 req-1f4a0b32-3a2d-450c-8adc-435ce3e6a4e3 service nova] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Received event network-vif-deleted-dcc2a81c-89eb-4197-9265-f765af0c3ee1 {{(pid=72409) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 23:41:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:29 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:41:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:41:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Cleaning up deleted instances {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 23:41:31 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] There are 0 instances to clean {{(pid=72409) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 23:41:33 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:41:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:41:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:41:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:41:33 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:41:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:41:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:41:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8945MB free_disk=25.29769515991211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing inventories for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating ProviderTree inventory for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Updating inventory in ProviderTree for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing aggregate associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, aggregates: None {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Refreshing trait associations for resource provider 3270f7d5-46eb-4359-8572-5a68440c59c2, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV {{(pid=72409) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:41:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:41:39 user nova-compute[72409]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691624484.3968427, 99ebe55d-7c0e-4287-b60a-25027a0c3b90 => Stopped> {{(pid=72409) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 23:41:39 user nova-compute[72409]: INFO nova.compute.manager [-] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] VM Stopped (Lifecycle Event)
Aug 09 23:41:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-57553568-5483-412c-a435-9db194dd163c None None] [instance: 99ebe55d-7c0e-4287-b60a-25027a0c3b90] Checking state {{(pid=72409) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 23:41:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:41:39 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:41:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:41:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:41:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 23:41:39 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:41:39 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:41:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:41:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:41:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:41:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:41:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:44 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:41:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:41:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:41:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:41:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:41:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:41:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:41:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:42:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:42:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:42:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:42:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:42:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:42:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:21 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:42:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:42:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:42:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:42:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:42:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:31 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:42:33 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:42:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:42:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:42:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:42:33 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:42:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:42:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:42:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8954MB free_disk=25.296722412109375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:42:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:42:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:42:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:42:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:42:34 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:42:34 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:42:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:42:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:42:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:35 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:39 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:42:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:42:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:42:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 23:42:39 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:42:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:42:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:39 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:42:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:42:41 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:42:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:42:43 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:42:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:46 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:42:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:42:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:43:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:15 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:33 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:43:33 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:43:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:43:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:43:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:43:33 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:43:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:43:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:43:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=25.294414520263672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:43:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:43:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:43:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:43:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:43:34 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:43:34 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:43:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:43:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:43:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:43:39 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:43:39 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:43:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:40 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:43:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:43:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:43:40 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 23:43:41 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:43:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:43:43 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:43:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:45 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:43:48 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:43:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:43:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:43:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:43:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:43:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:43:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72409) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 23:43:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:43:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72409) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 23:43:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:43:59 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:44:04 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:44:09 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:44:14 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:44:19 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:44:24 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:44:29 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:44:33 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:44:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:44:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:44:33 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:44:33 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Auditing locally available compute resources for user (node: user) {{(pid=72409) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 23:44:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:44:34 user nova-compute[72409]: WARNING nova.virt.libvirt.driver [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 23:44:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=25.292179107666016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=72409) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 23:44:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 23:44:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 23:44:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:44:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 23:44:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72409) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 23:44:34 user nova-compute[72409]: DEBUG nova.compute.provider_tree [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed in ProviderTree for provider: 3270f7d5-46eb-4359-8572-5a68440c59c2 {{(pid=72409) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 23:44:34 user nova-compute[72409]: DEBUG nova.scheduler.client.report [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Inventory has not changed for provider 3270f7d5-46eb-4359-8572-5a68440c59c2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72409) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 23:44:34 user nova-compute[72409]: DEBUG nova.compute.resource_tracker [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Compute_service record updated for user:user {{(pid=72409) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 23:44:34 user nova-compute[72409]: DEBUG oslo_concurrency.lockutils [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=72409) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 23:44:34 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:44:36 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:44:38 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:44:38 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72409) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 23:44:39 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:44:42 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:44:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Starting heal instance info cache {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 23:44:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Rebuilding the list of instances to heal {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 23:44:42 user nova-compute[72409]: DEBUG nova.compute.manager [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Didn't find any instances for network info cache update. {{(pid=72409) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 23:44:43 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:44:43 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:44:43 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:44:44 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 23:44:45 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:44:46 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:44:48 user nova-compute[72409]: DEBUG oslo_service.periodic_task [None req-afac689a-3acb-426b-a2bd-4c0ec8cbb311 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72409) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 23:44:49 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 23:44:54 user nova-compute[72409]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72409) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}